-- Logs begin at Tue 2022-08-23 07:22:16 UTC, end at Tue 2022-08-23 08:45:21 UTC. -- Aug 23 08:06:45.738516 dv-cinder-854070-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 08:06:45.746000 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 08:06:45 2022] *** Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: nodename: dv-cinder-854070-4-iscsi Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: machine: x86_64 Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: clock source: unix Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: pcre jit disabled Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: detected number of CPU cores: 4 Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: current working directory: / Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: detected binary path: /usr/bin/uwsgi-core Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: your processes number limit is 47680 Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: your memory page size is 4096 bytes Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: detected max file descriptor number: 2048 Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: lock engine: pthread robust mutexes Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: thunder lock: enabled Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 08:06:45.750982 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 08:06:45.789576 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: Python main interpreter initialized at 0x55d5c65659c0 Aug 23 08:06:45.789576 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: python threads support enabled Aug 23 08:06:45.789576 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: your server socket listen backlog is limited to 100 connections Aug 23 08:06:45.789576 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: your mercy for graceful operations on workers is 90 seconds Aug 23 08:06:45.789916 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 08:06:45.789993 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: *** Operational MODE: preforking *** Aug 23 08:06:45.790268 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: *** uWSGI is running in multiple interpreter mode *** Aug 23 08:06:45.790268 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: spawned uWSGI master process (pid: 106146) Aug 23 08:06:45.790472 dv-cinder-854070-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 08:06:45.791891 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: spawned uWSGI worker 1 (pid: 106147, cores: 1) Aug 23 08:06:45.791891 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: spawned uWSGI worker 2 (pid: 106148, cores: 1) Aug 23 08:06:45.791891 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 08:06:46.456212 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 08:06:46.456814 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 08:06:47.544449 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 08:06:47.544449 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: from cryptography.utils import int_from_bytes Aug 23 08:06:47.545202 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 08:06:47.545202 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: from cryptography.utils import int_from_bytes Aug 23 08:06:47.553058 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 08:06:47.553058 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: from cryptography.utils import int_from_bytes Aug 23 08:06:47.553483 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 08:06:47.553483 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: from cryptography.utils import int_from_bytes Aug 23 08:06:50.023584 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 08:06:50.024124 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 08:06:50.024334 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 08:06:50.024691 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 08:06:50.024939 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 08:06:50.025315 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.025632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.025946 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.026134 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 08:06:50.026494 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.026588 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 08:06:50.026680 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.026855 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.026961 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 08:06:50.027196 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.027285 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 08:06:50.027509 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.027618 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 08:06:50.027825 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.027912 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.028077 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.028216 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.028384 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.028539 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.028699 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854070-4-iscsi {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.028861 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.029012 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.029193 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.029315 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.029513 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.029617 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.029837 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.029929 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.030160 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.030253 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.030489 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.030582 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.030749 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.030837 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.031140 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.031292 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.031443 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854070-4-iscsi {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.032421 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.032567 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.032708 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.032794 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.032867 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.032944 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033021 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033098 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033178 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033252 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033336 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033422 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033501 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033578 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.033801 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.034047 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.034157 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.034378 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.034464 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.034707 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.034795 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854070-4-iscsi {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.035044 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.035150 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.035383 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.035519 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.035695 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.036314 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.036539 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.036676 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.036864 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.037000 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.037188 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.037313 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.037502 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.037638 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.037843 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.037977 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.038117 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.038252 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854070-4-iscsi {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.038412 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.038539 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.038724 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.038863 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.039058 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.039188 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.039372 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.039597 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.039726 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.039926 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.040054 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.040244 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.040370 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.040552 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.040677 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.040848 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.040977 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.041142 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.041268 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.041401 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.041533 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.041669 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.041804 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.041971 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.042107 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.042283 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.042426 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.042596 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.042736 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.042868 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.043024 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.043149 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.043320 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.043448 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.043662 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.043818 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.043968 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.044109 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.044267 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.044404 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.044537 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.044671 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.044806 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.044941 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.045103 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.045229 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.045422 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.045547 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.045720 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.045856 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.045994 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.046120 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.046256 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.046390 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.046522 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.046655 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.046826 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.046985 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.047158 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.047287 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.047469 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.047609 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.047776 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.047917 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.048107 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.048247 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.048384 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.048509 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.048694 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.048822 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.049002 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.049145 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.049302 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.049427 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.049616 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.049743 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.049928 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.050139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.050274 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.050405 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.050535 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.050658 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.050800 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.051000 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.051130 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.051264 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.052059 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.052196 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.052365 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.052503 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.052636 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.052767 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.052913 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.053039 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.053213 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.053340 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.053523 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.053650 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.053821 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.053954 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.054123 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.054257 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.054508 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.054636 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.054808 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.054935 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.055135 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.055265 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.055435 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.055563 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.055735 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.055862 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.056020 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.056163 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.056341 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.056468 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.056591 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.056716 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.056891 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.057027 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.057188 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.057325 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.057487 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.057633 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.057794 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.057920 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.058157 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.058293 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.058416 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.058548 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.058674 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.058796 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.058988 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.059134 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.059291 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.059428 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.059603 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.059732 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.059905 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.060033 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.060202 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.060343 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.060514 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.060678 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.060805 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.060944 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.061099 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.061242 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.061408 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.061544 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.061707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.061836 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.062004 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.062149 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.062313 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.062442 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.062610 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.062743 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.062899 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.063060 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.063231 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.063359 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.063530 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.063658 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.063828 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.063968 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.064123 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.064260 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.064417 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.064548 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.064711 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.064841 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.065008 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.065147 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.065301 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.065433 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.065595 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.065724 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.065886 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.066013 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.066194 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.066323 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.066505 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.066634 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.066803 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.066930 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.067163 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.067291 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.067464 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.067602 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.067776 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.067909 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.068080 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.068243 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.068434 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.068561 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.068684 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.068814 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.068986 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.069124 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.069287 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.069427 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.069606 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.069736 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.069925 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.070067 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.070237 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.070364 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.070541 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.070674 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.070847 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.071041 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.071177 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.071302 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:06:50.071468 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.071598 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.071774 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.071903 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.072085 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.072212 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.072398 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.072527 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.072719 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.073108 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.073296 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.073424 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.073608 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.073734 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.073920 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.074057 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.074224 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.074351 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.074562 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.074699 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.074837 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.074986 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.075170 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.075310 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.075473 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.075602 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.075807 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.075936 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.076141 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.076275 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.076447 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.076583 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.076767 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.076894 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.077081 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.077208 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.077386 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.077523 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.077690 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.077825 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.077996 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.078126 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.078312 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.078466 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.078659 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.078823 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.078987 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.079126 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.079251 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.079384 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.079520 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.079656 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.079834 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.079962 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.080140 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.080277 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.080444 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.080573 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.080749 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.080876 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.081075 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.081205 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.081382 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.081509 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.081691 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.081819 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.081997 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.082127 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.082309 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.082443 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.082614 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.082741 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.082959 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.083104 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.083269 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.083397 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.083569 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.083698 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.083868 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.083998 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.084167 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.084295 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.084472 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.084609 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.084774 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.084914 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.085088 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.085216 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.085412 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.085553 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.085713 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.085842 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.086038 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.086165 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.086339 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.086478 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.086645 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.086777 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.087006 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.087151 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.087277 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.087415 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.087571 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.087699 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.087878 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.088006 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.088185 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.088312 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.088484 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.088611 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.088816 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.088945 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.089079 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.089205 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.089382 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.089517 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.089702 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.089843 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.090001 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.090132 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.090299 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.090429 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.090607 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.090743 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.090914 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.091067 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.091242 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.091382 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.091546 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.091684 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.091853 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.091989 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.092171 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.092307 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.092477 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.092614 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.092782 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.092910 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.093104 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.093252 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.093412 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.093554 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.093711 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.093839 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.094026 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.094152 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.094341 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.094474 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.094649 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.094786 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.094989 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.095133 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.095268 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.095396 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.095559 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.095687 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.095856 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.095983 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.096153 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.096282 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.096455 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.096583 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.096750 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.096877 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.097048 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.097178 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.097346 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.097475 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.097641 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.097769 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.097936 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.098065 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.098249 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.098972 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.099115 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.099250 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.099383 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.099516 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.099672 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.099802 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.099974 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.100183 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.100319 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.100445 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.100595 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.100724 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.100928 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.101065 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.101254 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.101382 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.101557 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.101685 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.101863 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.102004 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.102165 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.102292 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.102477 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.102613 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.102780 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.102907 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.103106 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.103235 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.103409 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.103546 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.103711 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.103839 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.104025 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.104153 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.104329 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.104458 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.104639 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.104769 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.104943 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.105072 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.105259 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.105388 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.105561 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.105698 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.105873 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.106003 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.106172 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.106300 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.106482 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.106611 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.106814 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.106975 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.107163 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.107306 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.107472 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.107598 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.107781 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.107907 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.108083 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.108220 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.108392 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.108521 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.108697 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.108824 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.109027 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.109178 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.109305 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.109428 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.109592 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.109727 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.109908 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.110045 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.110211 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.110339 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.110522 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.110650 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.110825 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.110977 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.111190 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.111319 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.111493 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.111624 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.111805 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.111934 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.112102 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.112232 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.112411 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.112540 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.112721 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.112848 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.113034 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.113169 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.113337 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.113463 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.113642 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.113772 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.114495 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.114628 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.114822 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.114996 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.115141 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.115267 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.115445 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.115573 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.115745 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.115883 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.116044 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.116173 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.116349 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.116480 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.116656 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.116798 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.116961 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.117089 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.117264 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.117401 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.117563 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.117700 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.117871 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.118001 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.118174 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.118311 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.118471 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.118609 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.118771 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.118900 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.119137 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.119273 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.119406 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.119532 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.119706 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.119833 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.120025 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.120161 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.120342 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.120472 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.120641 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.120769 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.120938 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.121066 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.121253 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.121389 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.121555 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.121682 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.121855 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.121991 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.122154 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.122283 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.122450 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.122580 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.122769 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.122904 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.123091 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.123214 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.123388 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.123525 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.123701 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.123844 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.124008 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.124134 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.124328 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.124470 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.124596 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.124738 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.124905 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.125035 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.125207 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.125336 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.125521 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.125658 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.125822 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.125961 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.126123 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.126249 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.126425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.126554 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.126727 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.126866 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.127050 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.127180 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.127354 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.127484 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.127668 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.127797 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.127970 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.128097 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.128273 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.128402 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.128574 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.128711 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.128871 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.129001 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.129220 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.129413 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.129541 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.129665 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.129846 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.130049 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.130179 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.130382 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.130511 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.130697 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.130834 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.131039 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.131176 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.131358 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.131486 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.131674 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.131801 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.131997 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.132134 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.132303 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.132432 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.132613 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.132743 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.132928 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.133068 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.133234 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.133487 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.133623 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.133819 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.133947 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.134123 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.134251 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.134423 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.134558 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.134722 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.134850 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.135043 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.135183 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.135348 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.135476 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.135646 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.135787 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.135943 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.136072 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.136242 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.136383 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.136542 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.136663 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.136850 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.136988 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.137149 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.137286 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.137454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.137582 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.137752 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.137891 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.138068 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.138197 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.138370 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.138499 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.138669 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.138799 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.138988 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.139115 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.139271 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.139415 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.139617 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.139900 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.140028 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.140225 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.140362 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.140531 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.140660 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.140842 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.140978 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.141149 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.141285 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.141443 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.141570 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.141761 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.141895 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.142059 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.142200 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.142355 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.142483 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.142651 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.142779 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.142973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.143118 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.143283 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.143411 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.143581 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.143709 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.143882 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.144012 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.144184 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.144311 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.144487 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.144622 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.144787 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.144916 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.145083 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.145211 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.145411 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.145546 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.145707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.145836 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.146013 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.146142 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.146311 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.146440 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.146605 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.146734 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.146898 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.147041 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.147236 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.147375 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.147536 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.147664 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.147831 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.147959 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.148132 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.148269 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.148427 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.148555 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.148733 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.148870 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.149028 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.149165 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.149324 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.149452 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.149654 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.149798 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.149925 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.150064 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.150211 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.150340 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.150506 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.150634 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.150811 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.151001 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.151129 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.151251 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.151417 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.151545 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.151714 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.151844 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.152016 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.152144 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.152311 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.152439 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.152636 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.152763 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.152894 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.153019 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.153197 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.153325 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.153505 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.153642 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.153802 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.153930 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.154109 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.154247 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.154407 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.154543 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.154705 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.154833 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.155024 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.155166 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.155328 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.155456 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.155635 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.155760 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.155940 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.156081 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.156251 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.156387 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.156553 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.156680 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.156853 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.156989 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.157164 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.157300 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.157466 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.157601 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.157766 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.157896 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.158067 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.158195 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.158364 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.158492 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.158670 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.158804 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.158993 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.159123 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.159299 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.159429 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.159601 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.159744 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.159932 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.160068 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.160194 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.160324 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.160504 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.160642 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.161333 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.161474 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.161642 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.161778 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.161939 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.162066 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.162241 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.162374 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.162546 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.162673 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.162852 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.163189 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.163321 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.163445 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.163570 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.163707 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.163833 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.163960 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.164084 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.164207 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.164331 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.164463 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.164638 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.164797 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.164952 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.165113 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.165269 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.165418 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.165553 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.165734 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.165861 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.166047 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.166191 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.166379 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.166507 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.166684 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.166812 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.167063 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.167206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.167340 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.167463 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.167614 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.167743 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.167919 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.168061 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.168224 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.168352 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.168526 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.168661 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.168826 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.168966 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.169129 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.169257 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.169431 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.169559 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.169728 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.169857 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.170059 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.170196 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.170343 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.170471 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.170640 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.170770 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.170959 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.171091 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.171266 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.171393 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.171570 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.171700 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.171867 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.171997 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.172185 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.172319 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.172491 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.172612 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.172802 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.172930 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.173112 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.173249 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.173418 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.173547 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.173728 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.173854 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.174036 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.174174 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.174336 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.174462 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.174632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.174765 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.174975 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.175124 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.175289 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.175425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.175593 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.175721 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.175933 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.176073 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.176232 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.176359 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.177062 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.177196 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.177368 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.177499 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.177686 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.177815 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.177985 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.178113 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.178281 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.178411 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.178578 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.178706 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.178893 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.179038 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.179218 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.179378 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.179532 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.179689 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.179941 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.180089 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.180289 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.180428 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.180562 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.180694 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.180912 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.181048 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.181225 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.181363 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.181529 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.181656 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.181840 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.182042 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.182170 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.182293 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.182424 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.182549 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.182741 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.182878 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.183070 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.183199 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.183385 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.183514 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.183704 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.183841 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.184021 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.184150 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.184327 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.184454 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.184636 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.184787 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.184922 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.185085 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.185236 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.185396 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.185550 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.185720 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.185858 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.186064 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.186194 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.186388 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.186549 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.186686 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.186864 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.187041 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.187190 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.187318 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.187506 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.187635 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.187825 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.187954 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.188124 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.188259 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.188422 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.188552 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.188726 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.188857 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.189023 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.189152 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.189321 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.189457 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.189637 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.189766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.189935 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.190072 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.190243 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.190456 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.190595 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.190758 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.190897 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.191093 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.191222 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.191416 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.191546 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.191733 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.191861 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.192052 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.192260 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.192389 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.192514 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.192649 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.192773 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.192962 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.193098 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.193267 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.193397 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.193564 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.193690 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.193880 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.194018 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.194185 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.194322 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.194483 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.194618 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.194779 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.194917 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.195101 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.195230 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.195412 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.195532 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.195723 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.195852 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.196027 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.196162 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.196346 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.196473 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.196665 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.196796 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.196967 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.197099 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.197293 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.197424 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.197608 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.197737 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.198182 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.198309 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.198492 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.198627 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.198798 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.198928 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.199116 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.199240 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.199403 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.199543 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.199709 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.199837 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.200007 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.200137 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.200310 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.200464 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.200662 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.200792 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.200916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.201039 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.201163 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.201319 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.201450 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.201653 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.201820 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.201979 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.202107 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.202300 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.202431 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.202621 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.202749 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.202922 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.203085 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.203243 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.203380 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.203542 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.203670 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.203841 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.203979 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.204163 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.204298 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.204467 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.204594 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.204768 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.204905 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.205078 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.205207 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.205382 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.205512 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.205685 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.205823 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.205986 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.206114 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.206290 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.206418 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.206598 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.206726 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.206903 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.207108 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.207235 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.207359 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.207528 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.207680 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.207857 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.207993 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.208162 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.208291 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.208468 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.208596 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.208779 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.208907 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.209139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.209275 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.209453 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.209583 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.209779 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.209907 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.210097 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.210239 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.210419 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.210554 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.210759 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.210903 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.211055 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.211197 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.211375 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.211511 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.211680 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.211809 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.211986 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.212123 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.212290 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.212428 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.212604 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.212730 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.212914 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.213044 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.213234 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.213361 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.213557 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.213754 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.213893 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.214086 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.214224 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.214404 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.214534 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.214738 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.214874 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.215082 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.215222 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.215399 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.215527 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.215699 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.215829 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.216004 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.216142 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.216311 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.216447 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.216619 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.216748 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.216923 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.217053 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.217227 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.217365 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.217532 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.217669 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.217834 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.217962 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.218136 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.218284 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.218439 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.218576 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.218743 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.218872 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.219070 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.219211 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.219389 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.219521 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.219713 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.219843 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.220029 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.220161 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.220342 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.220479 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.220647 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.220776 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.221062 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.221201 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.221328 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.221451 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.221583 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.221753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.221895 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.222078 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.222207 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.222395 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.222525 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.222711 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.222850 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.223053 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.223176 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.223887 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.224019 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.224212 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.224343 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.224513 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.224650 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.224813 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.224943 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.225118 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.225248 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.225423 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.225551 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.225720 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.225848 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.226035 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.226164 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.226338 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.226609 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.226744 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.226930 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.227118 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.227245 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.227374 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.227600 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.227768 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.227912 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.228108 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.228245 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.228420 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.228549 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.228739 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.228877 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.229059 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.229188 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.229370 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.229499 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.229673 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.229817 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.229993 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.230121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.230295 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.230423 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.230595 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.230725 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.230911 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.231061 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.231240 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.231370 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.231539 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.231669 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.231839 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.231967 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.232144 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.232397 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.232535 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.232734 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.232862 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.233040 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.233169 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.233340 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.233478 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.233658 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.233796 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.233958 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.234086 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.234258 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.234388 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.234556 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.234685 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.234862 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.235023 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.235186 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.235317 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.235485 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.235613 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.235783 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.235906 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.236082 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.236212 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.236387 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.236514 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.236683 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.236810 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.236987 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.237117 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.237288 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.237423 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.237592 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.237722 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.237889 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.238026 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.238192 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.238321 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.238488 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.238627 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.238802 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.238989 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.239668 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.239798 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.239986 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.240126 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.240296 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.240425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.240603 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.240732 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.240914 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.241052 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.241220 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.241348 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.241526 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.241654 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.241829 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.241958 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.242142 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.242271 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.242450 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.242674 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.242805 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.243028 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.243161 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.243347 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.243477 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.243674 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.243813 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.244002 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.244130 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.244306 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.244433 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.244604 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.244733 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.244903 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.245031 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.245223 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.245352 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.245531 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.245661 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.245837 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.245973 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.246143 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.246272 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.246448 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.246578 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.246753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.246890 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.247082 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.247393 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.247536 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.247696 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.247824 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.247999 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.248129 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.248303 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.248446 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.248606 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.248745 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.248910 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.249039 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.249213 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.249351 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.249517 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.249647 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.249823 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.249951 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.250155 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.250285 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.250468 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.250597 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.250783 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.250918 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.251173 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.251302 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.251426 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.251549 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.251703 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.251850 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.252007 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.252136 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.252308 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.252437 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.252609 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.252757 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.252915 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.253044 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.253223 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.253350 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.253527 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.253665 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.253825 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.253963 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.254133 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.254260 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.254448 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.254598 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.254838 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.255001 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.255176 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.255303 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.255480 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.255611 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.255795 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.255924 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.256110 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.256238 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.256421 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.256553 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.256732 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.256862 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.257043 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.257185 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.257354 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.257490 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.257671 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.257806 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.258002 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.258146 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.258316 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.258444 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.258613 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.258740 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.258917 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.259094 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.259221 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.259345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.259527 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.259657 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.259837 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.259967 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.260139 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.260267 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.260435 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.260599 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.260737 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.260925 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.261056 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.261237 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.261366 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.261560 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.261698 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.261872 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.262000 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.262167 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.262295 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.262468 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.262607 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.262762 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.262891 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.263081 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.263212 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.263377 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.263507 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.263672 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.263802 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.263968 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.264098 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.264263 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.264401 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.264568 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.264697 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.264866 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.264994 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.265162 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.265300 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.265457 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.265586 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.265754 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.265883 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.266048 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.266185 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.266369 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.266497 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.266695 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.266839 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.267030 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.267160 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.267349 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.267477 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.267649 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.267787 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.267954 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.268083 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.268256 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.268391 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.268556 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.268696 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.268873 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.268999 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.269174 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.269300 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.269478 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.269605 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.269780 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.269907 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.270085 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.270242 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.270415 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.270547 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.270723 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.270850 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.271051 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.271180 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.271356 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.271486 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.271661 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.271791 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.271979 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.272108 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.272298 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.272429 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.272598 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.272729 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.272917 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.273054 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.273227 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.273355 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.273538 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.273661 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.273846 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.273983 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.274150 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.274279 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.274469 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.274597 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.274771 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.274908 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.275083 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.275220 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.275392 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.275522 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.275696 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.275827 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.276000 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.276128 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.276307 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.276436 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.276612 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.276742 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.276914 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.277043 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.277222 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.277360 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.277536 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.277665 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.277856 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.277984 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.278173 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.278302 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.278478 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.278608 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.278794 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.278973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.279135 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.279342 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.279471 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.279595 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.279764 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.279892 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.280076 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.280215 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.280387 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.280516 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.280698 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.280826 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.281003 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.281176 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.281311 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.281436 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.281560 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 08:06:50.281683 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.281910 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.282226 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.282542 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.282869 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.283234 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.283553 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.283879 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.284207 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.284551 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.284863 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.285206 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.285535 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.286369 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.286683 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.287010 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:06:50.287256 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 08:06:50.436265 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO dbcounter [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Registered counter for database nova_api Aug 23 08:06:50.441105 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO dbcounter [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Registered counter for database nova_api Aug 23 08:06:50.457333 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_db.sqlalchemy.engines [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:06:50.463345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_db.sqlalchemy.engines [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:06:50.464544 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writer thread running {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:06:50.469784 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writer thread running {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:06:50.520799 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.context [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cfa477d1-7cac-413e-8fa7-186dfaa13509(cell1) {{(pid=106147) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 08:06:50.524689 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:06:50.525163 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:06:50.525992 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.context [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cfa477d1-7cac-413e-8fa7-186dfaa13509(cell1) {{(pid=106148) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 08:06:50.526718 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:06:50.527482 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:06:50.527924 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:06:50.529858 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_concurrency.lockutils [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:06:50.529953 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:06:50.530333 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_concurrency.lockutils [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:06:50.531930 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO dbcounter [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Registered counter for database nova_cell0 Aug 23 08:06:50.532027 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_concurrency.lockutils [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:06:50.532695 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_concurrency.lockutils [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:06:50.533144 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_concurrency.lockutils [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:06:50.535160 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_concurrency.lockutils [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:06:50.537700 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO dbcounter [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Registered counter for database nova_cell0 Aug 23 08:06:50.537806 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO dbcounter [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Registered counter for database nova_cell1 Aug 23 08:06:50.543097 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO dbcounter [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Registered counter for database nova_cell1 Aug 23 08:06:50.545581 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_db.sqlalchemy.engines [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:06:50.547451 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_db.sqlalchemy.engines [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:06:50.549840 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_db.sqlalchemy.engines [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:06:50.552330 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_db.sqlalchemy.engines [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:06:50.553746 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writer thread running {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:06:50.555269 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writer thread running {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:06:50.556561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writer thread running {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:06:50.560273 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writer thread running {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:06:50.697520 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO dbcounter [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Registered counter for database nova_cell0 Aug 23 08:06:50.703952 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO dbcounter [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Registered counter for database nova_cell0 Aug 23 08:06:50.704472 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_db.sqlalchemy.engines [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:06:50.709425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writer thread running {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:06:50.713184 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG oslo_db.sqlalchemy.engines [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:06:50.717513 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writer thread running {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:06:51.117556 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: WARNING keystonemiddleware.auth_token [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 08:06:51.124807 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: WARNING keystonemiddleware.auth_token [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 08:06:51.135407 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: WARNING keystonemiddleware.auth_token [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 08:06:51.142537 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: WARNING keystonemiddleware.auth_token [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 08:06:51.466188 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: WARNING keystonemiddleware.auth_token [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 08:06:51.472159 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: WARNING keystonemiddleware.auth_token [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 08:06:51.477472 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5c65659c0 pid: 106147 (default app) Aug 23 08:06:51.479551 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:06:51.480727 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001749 Aug 23 08:06:51.481127 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Tue Aug 23 08:06:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:06:51.483027 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: WARNING keystonemiddleware.auth_token [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 08:06:51.489480 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: WARNING keystonemiddleware.auth_token [None req-bd436764-2628-45f6-8124-fad77b3f7851 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 08:06:51.494743 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d5c65659c0 pid: 106148 (default app) Aug 23 08:08:11.846261 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:11.847309 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 23 08:08:11.847705 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:08:11.859530 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writing DB stats nova_api:SELECT=3 {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:11.861434 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writing DB stats nova_cell0:SELECT=3 {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:11.862494 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writing DB stats nova_cell1:SELECT=3 {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:11.863798 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:12.714059 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-2da99819-1b27-4310-85d2-b01e288f5c83 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:12.745968 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-2da99819-1b27-4310-85d2-b01e288f5c83 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.891470 Aug 23 08:08:12.750222 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Aug 23 08:08:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:08:15.088306 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:15.088964 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-67ae1e3e-24cf-40f8-b127-34c652969a15 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 23 08:08:15.094009 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:15.544286 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-e7c9f208-a40b-4d7e-867c-460111b3827b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "swap": 0}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:15.561627 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:08:15.561627 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: warnings.warn(msg) Aug 23 08:08:15.657306 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-e7c9f208-a40b-4d7e-867c-460111b3827b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.560618 Aug 23 08:08:15.658330 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:08:15.886220 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-2be63d31-7aa6-45c4-bc73-a39fea34ac2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:15.891476 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:08:15.891476 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: warnings.warn(msg) Aug 23 08:08:15.894490 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_api:SELECT=3 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:15.895448 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_cell0:SELECT=3 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:15.896465 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_cell1:SELECT=3 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:15.897181 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:16.043409 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-2be63d31-7aa6-45c4-bc73-a39fea34ac2e admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.374664 Aug 23 08:08:16.047941 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Aug 23 08:08:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:08:18.394472 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-e7c9f208-a40b-4d7e-867c-460111b3827b admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:18.395626 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-e7c9f208-a40b-4d7e-867c-460111b3827b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Aug 23 08:08:18.396140 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:19.051323 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-b6fbc8a4-8989-48de-8335-9518f9d8f1bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "name": "ds512M", "ram": 512}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:19.070287 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:08:19.070287 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: warnings.warn(msg) Aug 23 08:08:19.154658 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-b6fbc8a4-8989-48de-8335-9518f9d8f1bb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.751591 Aug 23 08:08:19.157465 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:08:19.167835 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-d6d53e81-43b1-4b75-8606-c20335fe97a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:19.170979 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:08:19.170979 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: warnings.warn(msg) Aug 23 08:08:19.284236 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-d6d53e81-43b1-4b75-8606-c20335fe97a7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120248 Aug 23 08:08:19.284853 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Aug 23 08:08:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:08:21.669562 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-b6fbc8a4-8989-48de-8335-9518f9d8f1bb admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:21.670698 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-b6fbc8a4-8989-48de-8335-9518f9d8f1bb admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Aug 23 08:08:21.671136 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:22.067084 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-b7fbba0d-e18e-4d3c-ac62-a66f7847ebea admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:22.170718 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-b7fbba0d-e18e-4d3c-ac62-a66f7847ebea admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.493206 Aug 23 08:08:22.171325 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:08:22.183428 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-88ac3d3b-bc2b-4a33-8407-6d5496a69490 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:22.271405 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-88ac3d3b-bc2b-4a33-8407-6d5496a69490 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091493 Aug 23 08:08:22.271914 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Aug 23 08:08:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:08:24.612176 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-b7fbba0d-e18e-4d3c-ac62-a66f7847ebea admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:24.613041 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-b7fbba0d-e18e-4d3c-ac62-a66f7847ebea admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 23 08:08:24.620027 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:24 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:25.077873 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-d506e9d5-0d41-4b04-8e2f-bf9edaed0665 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "id": "d3", "ram": 2048, "swap": 0}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:25.151328 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-d506e9d5-0d41-4b04-8e2f-bf9edaed0665 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529880 Aug 23 08:08:25.151875 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 08:08:25.164077 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-7f4e43c8-6136-4332-8596-6c2b81e701ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:25.260568 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-7f4e43c8-6136-4332-8596-6c2b81e701ce admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100138 Aug 23 08:08:25.261523 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Aug 23 08:08:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:08:27.608036 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-d506e9d5-0d41-4b04-8e2f-bf9edaed0665 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:27.608949 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-d506e9d5-0d41-4b04-8e2f-bf9edaed0665 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 23 08:08:27.609420 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:28.041306 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-4198b460-c66b-466b-8b9c-a8c9d5c56fdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "ram": 4096}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:28.103954 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-4198b460-c66b-466b-8b9c-a8c9d5c56fdc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.488156 Aug 23 08:08:28.104956 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:08:28.118171 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-8f88fc25-df1c-4e57-b378-ce45ddad6ddc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:28.202896 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-8f88fc25-df1c-4e57-b378-ce45ddad6ddc admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088340 Aug 23 08:08:28.203738 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Tue Aug 23 08:08:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:08:30.581159 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-4198b460-c66b-466b-8b9c-a8c9d5c56fdc admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:30.582198 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-4198b460-c66b-466b-8b9c-a8c9d5c56fdc admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 23 08:08:30.582605 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:31.002248 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-e3ce6313-e602-4f47-a6e9-650d54eb1d84 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:31.034212 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-e3ce6313-e602-4f47-a6e9-650d54eb1d84 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444954 Aug 23 08:08:31.034899 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Aug 23 08:08:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:08:33.346723 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-4198b460-c66b-466b-8b9c-a8c9d5c56fdc admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:33.347773 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-4198b460-c66b-466b-8b9c-a8c9d5c56fdc admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 23 08:08:33.348180 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:33.785263 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-9682321f-7a21-4769-9fd7-950f5328c24c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "name": "m1.tiny", "swap": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:33.872947 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-9682321f-7a21-4769-9fd7-950f5328c24c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.518711 Aug 23 08:08:33.873543 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 08:08:33.886295 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-36daff5b-016a-42a9-967f-b827553d1a1a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:33.969752 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-36daff5b-016a-42a9-967f-b827553d1a1a admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087066 Aug 23 08:08:33.970361 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Aug 23 08:08:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:08:36.392593 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-9682321f-7a21-4769-9fd7-950f5328c24c admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:36.393622 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-9682321f-7a21-4769-9fd7-950f5328c24c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 23 08:08:36.394045 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:36.797083 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-cf2b1fbd-4680-4712-bcf7-fec48d9bb71b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "disk": 20}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:36.883878 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-cf2b1fbd-4680-4712-bcf7-fec48d9bb71b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.483414 Aug 23 08:08:36.884555 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 08:08:36.896870 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-b7ffd34f-d3d7-4bb4-a83f-16174242200f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:36.962321 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-b7ffd34f-d3d7-4bb4-a83f-16174242200f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069041 Aug 23 08:08:36.962961 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Aug 23 08:08:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:08:39.293207 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-cf2b1fbd-4680-4712-bcf7-fec48d9bb71b admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:39.294188 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-cf2b1fbd-4680-4712-bcf7-fec48d9bb71b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 23 08:08:39.294592 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:39.691974 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-375db395-79b9-4a2e-9829-f0b6289c1495 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium"}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:39.764485 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-375db395-79b9-4a2e-9829-f0b6289c1495 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.463336 Aug 23 08:08:39.765797 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 08:08:39.777439 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-dcba3e50-ea15-476e-adc2-e8c2635fa2c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:39.854066 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-dcba3e50-ea15-476e-adc2-e8c2635fa2c2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080141 Aug 23 08:08:39.854691 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Aug 23 08:08:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:08:42.304396 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-375db395-79b9-4a2e-9829-f0b6289c1495 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:42.305402 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-375db395-79b9-4a2e-9829-f0b6289c1495 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 23 08:08:42.307340 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:42.797343 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-96ca3c62-667a-4427-b481-9334912b1fa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:42.803029 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:08:42.890330 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-96ca3c62-667a-4427-b481-9334912b1fa2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.569133 Aug 23 08:08:42.891081 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:08:42.902910 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-af1afa40-7685-4b04-b047-79c50b354fe2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:42.980294 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-af1afa40-7685-4b04-b047-79c50b354fe2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080931 Aug 23 08:08:42.981142 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Aug 23 08:08:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:08:45.360720 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-96ca3c62-667a-4427-b481-9334912b1fa2 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:08:45.361972 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-96ca3c62-667a-4427-b481-9334912b1fa2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001758 Aug 23 08:08:45.362914 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:08:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:08:45.813384 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-9be33aa9-bdbb-4968-82ee-f66671bf46b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5"}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:45.895879 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-9be33aa9-bdbb-4968-82ee-f66671bf46b6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.527324 Aug 23 08:08:45.896463 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Tue Aug 23 08:08:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:08:45.909574 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-a294984c-4deb-43da-9eac-17e1af449696 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:08:45.996912 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-a294984c-4deb-43da-9eac-17e1af449696 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091693 Aug 23 08:08:45.997577 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Tue Aug 23 08:08:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:09:05.906297 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-9be33aa9-bdbb-4968-82ee-f66671bf46b6 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:05.907394 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-9be33aa9-bdbb-4968-82ee-f66671bf46b6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 23 08:09:05.907799 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:09:06.293577 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-f5e8c764-92c4-42b9-a686-35a0758b61ce admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:06.312815 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-f5e8c764-92c4-42b9-a686-35a0758b61ce admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398941 Aug 23 08:09:06.313349 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Aug 23 08:09:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:09:07.366023 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-9be33aa9-bdbb-4968-82ee-f66671bf46b6 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:07.367058 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-9be33aa9-bdbb-4968-82ee-f66671bf46b6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 23 08:09:07.367454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:09:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:09:07.885194 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-b12a5807-2ab8-4121-b190-d1697f9c0ede admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:07.891343 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.wsgi [None req-b12a5807-2ab8-4121-b190-d1697f9c0ede admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-b12a5807-2ab8-4121-b190-d1697f9c0ede admin admin] Request method failure captured: Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Accept: application/json Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Accept-Encoding: gzip, deflate Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Connection: keep-alive Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Content-Length: 0 Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Host: 10.222.0.58 Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Openstack-Api-Version: compute 2.90 Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Openstack-System-Scope: None Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: User-Agent: python-novaclient Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Auth-Token: gAAAAABjBIsjINEkcbRmEmDd_yig7gTOczsO_0u6McddPMxzVJSzEs_E9vPf8KnwkGXKDcZTXtQTmeeGaULxlrLQgvon2p8dgd6kV_OzICcFrFQ_knTMpKpIS0zkxyWW23tz3EfPTEAHfQFzY8myPR1OILR1SqnBBhZZ54t2nh7LcEk4DzTWi90 Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Domain-Id: None Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Domain-Name: None Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Identity-Status: Confirmed Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Is-Admin-Project: True Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Domain-Id: default Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Domain-Name: Default Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Name: admin Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Role: member,reader,admin Aug 23 08:09:07.894561 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Roles: member,reader,admin Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee2616c3f460471aaf732aeea2d3bd15", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant: admin Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant-Name: admin Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User: admin Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Domain-Id: default Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Domain-Name: Default Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Id: 70cd347e5af341fcb03bb3178f2c4247 Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Name: admin Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: method: > Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: exception: Flavor 42 could not be found. Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: action_args: {'id': '42'} Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:09:07.896221 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:07.897345 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.898719 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-b12a5807-2ab8-4121-b190-d1697f9c0ede admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:09:07.900009 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-b12a5807-2ab8-4121-b190-d1697f9c0ede admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392799 Aug 23 08:09:07.900009 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Aug 23 08:09:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:07.906412 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-12aecbc6-6094-4eac-a4f2-7a5da2704cbc admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:07.910517 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:09:07.929041 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-12aecbc6-6094-4eac-a4f2-7a5da2704cbc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026880 Aug 23 08:09:07.929591 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Aug 23 08:09:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:09:07.939291 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-d0462d36-1e72-40d3-b3f2-cc2f4814dd82 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:07.963038 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-d0462d36-1e72-40d3-b3f2-cc2f4814dd82 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027331 Aug 23 08:09:07.963593 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Aug 23 08:09:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:09:07.973853 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-a87338ca-d7ae-45c0-8f58-f66c8ad1619f admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:07.979551 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.wsgi [None req-a87338ca-d7ae-45c0-8f58-f66c8ad1619f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-a87338ca-d7ae-45c0-8f58-f66c8ad1619f admin admin] Request method failure captured: Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Accept: application/json Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Accept-Encoding: gzip, deflate Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Connection: keep-alive Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Content-Length: 0 Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Host: 10.222.0.58 Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Openstack-Api-Version: compute 2.90 Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Openstack-System-Scope: None Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: User-Agent: python-novaclient Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Auth-Token: gAAAAABjBIsjINEkcbRmEmDd_yig7gTOczsO_0u6McddPMxzVJSzEs_E9vPf8KnwkGXKDcZTXtQTmeeGaULxlrLQgvon2p8dgd6kV_OzICcFrFQ_knTMpKpIS0zkxyWW23tz3EfPTEAHfQFzY8myPR1OILR1SqnBBhZZ54t2nh7LcEk4DzTWi90 Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Domain-Id: None Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Domain-Name: None Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Identity-Status: Confirmed Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Is-Admin-Project: True Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Domain-Id: default Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Domain-Name: Default Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Name: admin Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Role: member,reader,admin Aug 23 08:09:07.982753 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Roles: member,reader,admin Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee2616c3f460471aaf732aeea2d3bd15", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant: admin Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant-Name: admin Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User: admin Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Domain-Id: default Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Domain-Name: Default Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Id: 70cd347e5af341fcb03bb3178f2c4247 Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Name: admin Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: method: > Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: exception: Flavor 42 could not be found. Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: action_args: {'id': '42'} Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:09:07.988454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:07.989425 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:07.990707 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-a87338ca-d7ae-45c0-8f58-f66c8ad1619f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:09:07.992646 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-a87338ca-d7ae-45c0-8f58-f66c8ad1619f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014231 Aug 23 08:09:07.992646 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Aug 23 08:09:07 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:08.946231 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-d0462d36-1e72-40d3-b3f2-cc2f4814dd82 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:08.947261 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-d0462d36-1e72-40d3-b3f2-cc2f4814dd82 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 23 08:09:08.947925 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:09:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:09:09.465520 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-9b083b90-4594-4088-a1be-4a76e6822974 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:09.470747 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.wsgi [None req-9b083b90-4594-4088-a1be-4a76e6822974 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-9b083b90-4594-4088-a1be-4a76e6822974 admin admin] Request method failure captured: Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Accept: application/json Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Accept-Encoding: gzip, deflate Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Connection: keep-alive Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Content-Length: 0 Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Host: 10.222.0.58 Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Openstack-Api-Version: compute 2.90 Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Openstack-System-Scope: None Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: User-Agent: python-novaclient Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Auth-Token: gAAAAABjBIsk1dkDxO9j5JRYKN9Lifx_jyuyOleBrx3QHSoOICe-9rlvmf0tjqAUvDRYsPA8FXet2Pqp-fms7MAd1LxcS9N41_1OAGaqHc0y-2_AIuKKrM69fo5AWLBlzesVy6AYAwsTvlv9N-CsWNJBWIh2goH1KPmeYytBwTE4t_8PUjE2cTI Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Domain-Id: None Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Domain-Name: None Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Identity-Status: Confirmed Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Is-Admin-Project: True Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Domain-Id: default Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Domain-Name: Default Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Name: admin Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Role: member,reader,admin Aug 23 08:09:09.472278 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Roles: member,reader,admin Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee2616c3f460471aaf732aeea2d3bd15", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant: admin Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant-Name: admin Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User: admin Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Domain-Id: default Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Domain-Name: Default Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Id: 70cd347e5af341fcb03bb3178f2c4247 Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Name: admin Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: method: > Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: exception: Flavor 84 could not be found. Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: action_args: {'id': '84'} Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:09:09.473916 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:09.475835 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.477206 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-9b083b90-4594-4088-a1be-4a76e6822974 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:09:09.478574 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-9b083b90-4594-4088-a1be-4a76e6822974 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.388965 Aug 23 08:09:09.478574 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Aug 23 08:09:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:09.483987 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-5deba3ed-fb8f-410c-bc88-0d066c33fe14 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:09.499198 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-5deba3ed-fb8f-410c-bc88-0d066c33fe14 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019222 Aug 23 08:09:09.499737 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Aug 23 08:09:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:09:09.509236 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-332c34d9-5b5b-435c-b73b-1968252e72e2 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:09.525633 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-332c34d9-5b5b-435c-b73b-1968252e72e2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019892 Aug 23 08:09:09.526163 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Aug 23 08:09:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:09:09.535941 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-b0cb7a0c-2412-4ad6-b27b-580a8d4509db admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:09.541275 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.wsgi [None req-b0cb7a0c-2412-4ad6-b27b-580a8d4509db admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-b0cb7a0c-2412-4ad6-b27b-580a8d4509db admin admin] Request method failure captured: Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Accept: application/json Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Accept-Encoding: gzip, deflate Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Connection: keep-alive Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Content-Length: 0 Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Host: 10.222.0.58 Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Openstack-Api-Version: compute 2.90 Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Openstack-System-Scope: None Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: User-Agent: python-novaclient Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Auth-Token: gAAAAABjBIsk1dkDxO9j5JRYKN9Lifx_jyuyOleBrx3QHSoOICe-9rlvmf0tjqAUvDRYsPA8FXet2Pqp-fms7MAd1LxcS9N41_1OAGaqHc0y-2_AIuKKrM69fo5AWLBlzesVy6AYAwsTvlv9N-CsWNJBWIh2goH1KPmeYytBwTE4t_8PUjE2cTI Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Domain-Id: None Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Domain-Name: None Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Identity-Status: Confirmed Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Is-Admin-Project: True Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Domain-Id: default Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Domain-Name: Default Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Name: admin Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Role: member,reader,admin Aug 23 08:09:09.542766 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Roles: member,reader,admin Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee2616c3f460471aaf732aeea2d3bd15", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant: admin Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant-Name: admin Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User: admin Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Domain-Id: default Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Domain-Name: Default Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Id: 70cd347e5af341fcb03bb3178f2c4247 Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Name: admin Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: method: > Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: exception: Flavor 84 could not be found. Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: action_args: {'id': '84'} Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:09:09.544121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:09.545584 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:09.547025 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-b0cb7a0c-2412-4ad6-b27b-580a8d4509db admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:09:09.548290 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-b0cb7a0c-2412-4ad6-b27b-580a8d4509db admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011814 Aug 23 08:09:09.548290 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Tue Aug 23 08:09:09 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:10.506413 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-332c34d9-5b5b-435c-b73b-1968252e72e2 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:10.507448 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-332c34d9-5b5b-435c-b73b-1968252e72e2 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 23 08:09:10.507992 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:09:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:09:11.032976 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-75739e28-7de5-432c-ae42-cd0ae043c104 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:11.038631 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.wsgi [None req-75739e28-7de5-432c-ae42-cd0ae043c104 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-75739e28-7de5-432c-ae42-cd0ae043c104 admin admin] Request method failure captured: Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Accept: application/json Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Accept-Encoding: gzip, deflate Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Connection: keep-alive Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Content-Length: 0 Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Host: 10.222.0.58 Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Openstack-Api-Version: compute 2.90 Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Openstack-System-Scope: None Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: User-Agent: python-novaclient Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Auth-Token: gAAAAABjBIsmkdtA3rtEXHe9om5rDPFeuyKQDqSok-GsRjga4_DfcRkBd9ouRIMtgCS2d91SWmPntftJVDGnxW7b9dA-uUBxr6fUMLRfifYswylVj3TCz_82ZWeWuov9Z5J4zearaTgsRa6LnQ5VLVZeEZJxWliapAEeWuxNCiojLwyAXrkV9d0 Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Domain-Id: None Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Domain-Name: None Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Identity-Status: Confirmed Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Is-Admin-Project: True Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Domain-Id: default Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Domain-Name: Default Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Project-Name: admin Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Role: member,reader,admin Aug 23 08:09:11.040139 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Roles: member,reader,admin Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee2616c3f460471aaf732aeea2d3bd15", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant: admin Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-Tenant-Name: admin Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User: admin Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Domain-Id: default Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Domain-Name: Default Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Id: 70cd347e5af341fcb03bb3178f2c4247 Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: X-User-Name: admin Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: method: > Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: exception: Flavor 451 could not be found. Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: action_args: {'id': '451'} Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:09:11.041717 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:11.042672 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.043867 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-75739e28-7de5-432c-ae42-cd0ae043c104 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:09:11.045494 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-75739e28-7de5-432c-ae42-cd0ae043c104 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.396533 Aug 23 08:09:11.045494 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Aug 23 08:09:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 08:09:11.051671 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-103c1882-0597-49f5-b4d8-6be4a16f5c1d admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:11.066246 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-103c1882-0597-49f5-b4d8-6be4a16f5c1d admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018143 Aug 23 08:09:11.066779 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Aug 23 08:09:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:09:11.076361 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:11.090904 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018347 Aug 23 08:09:11.091941 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Tue Aug 23 08:09:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:09:11.101167 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-0a0d5bc4-f001-4887-9358-ceb79a3dce2c admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:11.106454 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.wsgi [None req-0a0d5bc4-f001-4887-9358-ceb79a3dce2c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-0a0d5bc4-f001-4887-9358-ceb79a3dce2c admin admin] Request method failure captured: Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Accept: application/json Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Accept-Encoding: gzip, deflate Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Connection: keep-alive Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Content-Length: 0 Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Host: 10.222.0.58 Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Openstack-Api-Version: compute 2.90 Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Openstack-System-Scope: None Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: User-Agent: python-novaclient Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Auth-Token: gAAAAABjBIsmkdtA3rtEXHe9om5rDPFeuyKQDqSok-GsRjga4_DfcRkBd9ouRIMtgCS2d91SWmPntftJVDGnxW7b9dA-uUBxr6fUMLRfifYswylVj3TCz_82ZWeWuov9Z5J4zearaTgsRa6LnQ5VLVZeEZJxWliapAEeWuxNCiojLwyAXrkV9d0 Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Domain-Id: None Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Domain-Name: None Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Identity-Status: Confirmed Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Is-Admin-Project: True Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Domain-Id: default Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Domain-Name: Default Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Project-Name: admin Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Role: member,reader,admin Aug 23 08:09:11.108080 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Roles: member,reader,admin Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee2616c3f460471aaf732aeea2d3bd15", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee2616c3f460471aaf732aeea2d3bd15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant: admin Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant-Id: ee2616c3f460471aaf732aeea2d3bd15 Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-Tenant-Name: admin Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User: admin Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Domain-Id: default Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Domain-Name: Default Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Id: 70cd347e5af341fcb03bb3178f2c4247 Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: X-User-Name: admin Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: method: > Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: exception: Flavor 451 could not be found. Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: action_args: {'id': '451'} Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:09:11.109624 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:11.110632 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: ERROR nova.api.openstack.wsgi Aug 23 08:09:11.111973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-0a0d5bc4-f001-4887-9358-ceb79a3dce2c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:09:11.113059 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-0a0d5bc4-f001-4887-9358-ceb79a3dce2c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011851 Aug 23 08:09:11.113059 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Aug 23 08:09:11 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 08:09:12.071415 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:12.077793 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 Aug 23 08:09:12.077793 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:09:12.588715 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-8816994e-aa01-4641-89c7-ea2ccba911b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:09:12.676870 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-8816994e-aa01-4641-89c7-ea2ccba911b3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.464728 Aug 23 08:09:12.677417 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Aug 23 08:09:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 08:09:13.658621 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:13.659698 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 23 08:09:13.660091 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:09:14.180022 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-fee1a24e-9323-47ec-896b-3d8c39ad4ae7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:09:14.276313 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-fee1a24e-9323-47ec-896b-3d8c39ad4ae7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.478759 Aug 23 08:09:14.276860 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Aug 23 08:09:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:09:15.237918 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:15.238933 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Aug 23 08:09:15.239360 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:09:15.767257 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-8b962783-af2b-464b-99aa-8b67b48e25f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:09:15.848872 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-8b962783-af2b-464b-99aa-8b67b48e25f0 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.471955 Aug 23 08:09:15.849421 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Aug 23 08:09:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:09:16.805961 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:16.806982 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 23 08:09:16.807375 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:09:17.323191 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-c0cfc62a-baf0-437a-9326-f2469c0f5b67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:09:17.384747 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-c0cfc62a-baf0-437a-9326-f2469c0f5b67 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.442342 Aug 23 08:09:17.385316 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Tue Aug 23 08:09:16 2022] POST /compute/v2.1/flavors => generated 409 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 08:09:18.369158 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:18.370188 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 23 08:09:18.370585 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:09:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:09:18.913270 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-7ab4e6c5-750b-4c4f-92b2-a8bdfa082cdc admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:09:18.933690 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-7ab4e6c5-750b-4c4f-92b2-a8bdfa082cdc admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.419958 Aug 23 08:09:18.934219 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Tue Aug 23 08:09:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:10:11.847779 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:10:11.848832 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-a2d51706-b031-4775-b2ca-3bd0388893c3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Aug 23 08:10:11.849233 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Tue Aug 23 08:10:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:10:11.860322 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:12.239298 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-be85e666-4ba4-4f68-9efb-85a621f469a6 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:10:12.260204 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-be85e666-4ba4-4f68-9efb-85a621f469a6 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404354 Aug 23 08:10:12.260744 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Tue Aug 23 08:10:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:10:12.281959 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG dbcounter [-] [106148] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:10:12.285834 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-1762fb7c-1218-441f-bd45-b3f7677a6328 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:10:12.293371 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-1762fb7c-1218-441f-bd45-b3f7677a6328 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012866 Aug 23 08:10:12.293887 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Tue Aug 23 08:10:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:10:12.305760 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-8106a2b4-7aac-4915-a6fc-8020389fcb40 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:10:12.313387 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-8106a2b4-7aac-4915-a6fc-8020389fcb40 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011231 Aug 23 08:10:12.313843 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Tue Aug 23 08:10:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:10:12.325731 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:10:12.333119 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010922 Aug 23 08:10:12.333667 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Tue Aug 23 08:10:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:10:12.345179 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-547296bf-ddfb-4d9b-83c6-603d7cfa61e5 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:10:12.352793 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-547296bf-ddfb-4d9b-83c6-603d7cfa61e5 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010979 Aug 23 08:10:12.353300 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Tue Aug 23 08:10:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:15:00.258679 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:15:00.259727 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 23 08:15:00.260121 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:15:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:15:00.400500 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_api:SELECT=6 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:15:00.544445 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-d7635fe7-e787-48da-a3a6-c7f65e9cf6e5 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:15:00.547952 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:15:00.547952 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: warnings.warn(msg) Aug 23 08:15:00.547952 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-d7635fe7-e787-48da-a3a6-c7f65e9cf6e5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:15:00.548404 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-d7635fe7-e787-48da-a3a6-c7f65e9cf6e5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:15:00.548823 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-d7635fe7-e787-48da-a3a6-c7f65e9cf6e5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:15:00.549549 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-d7635fe7-e787-48da-a3a6-c7f65e9cf6e5 admin admin] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:15:00.549985 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-d7635fe7-e787-48da-a3a6-c7f65e9cf6e5 admin admin] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:15:00.550392 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-d7635fe7-e787-48da-a3a6-c7f65e9cf6e5 admin admin] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:15:00.584346 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-d7635fe7-e787-48da-a3a6-c7f65e9cf6e5 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.185360 Aug 23 08:15:00.584905 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Aug 23 08:15:00 2022] GET /compute/v2.1/os-services => generated 791 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:15:01.403620 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:15:01.404648 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 23 08:15:01.405043 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:15:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:15:01.595085 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-0490036e-989c-4792-a901-8f9b8605ac28 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:15:01.597398 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:15:01.597398 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: warnings.warn(msg) Aug 23 08:15:01.598493 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-0490036e-989c-4792-a901-8f9b8605ac28 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:15:01.598976 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-0490036e-989c-4792-a901-8f9b8605ac28 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:15:01.599401 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-0490036e-989c-4792-a901-8f9b8605ac28 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:15:01.600132 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-0490036e-989c-4792-a901-8f9b8605ac28 admin admin] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:15:01.600569 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-0490036e-989c-4792-a901-8f9b8605ac28 admin admin] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:15:01.600974 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-0490036e-989c-4792-a901-8f9b8605ac28 admin admin] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:15:01.620412 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-0490036e-989c-4792-a901-8f9b8605ac28 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076791 Aug 23 08:15:01.620951 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Aug 23 08:15:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:15:12.858926 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:15:12.859948 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 23 08:15:12.860342 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 36/73] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:15:13.006236 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_cell0:SELECT=4 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:15:13.006973 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_cell1:SELECT=4 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:15:13.007608 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG dbcounter [-] [106147] Writing DB stats nova_api:SELECT=8 {{(pid=106147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:15:13.060466 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-db9ff2f2-713f-4cd4-bd18-0061a56f6fc6 admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:15:13.064268 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:15:13.064268 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: warnings.warn(msg) Aug 23 08:15:13.064691 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-db9ff2f2-713f-4cd4-bd18-0061a56f6fc6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:15:13.065161 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-db9ff2f2-713f-4cd4-bd18-0061a56f6fc6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:15:13.065589 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-db9ff2f2-713f-4cd4-bd18-0061a56f6fc6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:15:13.066303 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-db9ff2f2-713f-4cd4-bd18-0061a56f6fc6 admin admin] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:15:13.066746 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-db9ff2f2-713f-4cd4-bd18-0061a56f6fc6 admin admin] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:15:13.067182 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-db9ff2f2-713f-4cd4-bd18-0061a56f6fc6 admin admin] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:15:13.092364 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-db9ff2f2-713f-4cd4-bd18-0061a56f6fc6 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091450 Aug 23 08:15:13.093083 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 38/74] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Aug 23 08:15:12 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:15:13.918563 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: DEBUG nova.api.openstack.wsgi [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] Calling method '>' {{(pid=106148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:15:13.919625 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: INFO nova.api.openstack.requestlog [None req-23b39df4-3495-42f4-8cd5-5b34bec973d9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 23 08:15:13.920019 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: [pid: 106148|app: 0|req: 37/75] 10.222.0.58 () {56 vars in 1074 bytes} [Tue Aug 23 08:15:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:15:14.112705 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG nova.api.openstack.wsgi [None req-bd4f678d-ef30-402f-bb36-e84758fe55fe admin admin] Calling method '>' {{(pid=106147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:15:14.115139 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 08:15:14.115139 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: warnings.warn(msg) Aug 23 08:15:14.116244 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-bd4f678d-ef30-402f-bb36-e84758fe55fe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:15:14.116718 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-bd4f678d-ef30-402f-bb36-e84758fe55fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:15:14.117141 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-bd4f678d-ef30-402f-bb36-e84758fe55fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:15:14.117851 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-bd4f678d-ef30-402f-bb36-e84758fe55fe admin admin] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:15:14.118291 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-bd4f678d-ef30-402f-bb36-e84758fe55fe admin admin] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:15:14.118703 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: DEBUG oslo_concurrency.lockutils [None req-bd4f678d-ef30-402f-bb36-e84758fe55fe admin admin] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:15:14.139816 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: INFO nova.api.openstack.requestlog [None req-bd4f678d-ef30-402f-bb36-e84758fe55fe admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080114 Aug 23 08:15:14.140365 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: [pid: 106147|app: 0|req: 39/76] 10.222.0.58 () {60 vars in 1193 bytes} [Tue Aug 23 08:15:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:16:13.102421 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: Tue Aug 23 08:16:13 2022 - graceful shutdown triggered... Aug 23 08:16:13.102969 dv-cinder-854070-4-iscsi devstack@n-api.service[106147]: Gracefully killing worker 1 (pid: 106147)... Aug 23 08:16:13.102665 dv-cinder-854070-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 23 08:16:13.103802 dv-cinder-854070-4-iscsi devstack@n-api.service[106148]: Gracefully killing worker 2 (pid: 106148)... Aug 23 08:16:14.103030 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: worker 1 buried after 1 seconds Aug 23 08:16:14.103030 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: worker 2 buried after 1 seconds Aug 23 08:16:14.103030 dv-cinder-854070-4-iscsi devstack@n-api.service[106146]: goodbye to uWSGI. Aug 23 08:16:14.104498 dv-cinder-854070-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 23 08:16:14.105047 dv-cinder-854070-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 23 08:16:14.108037 dv-cinder-854070-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 08:16:14.118799 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 08:16:14 2022] *** Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: nodename: dv-cinder-854070-4-iscsi Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: machine: x86_64 Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: clock source: unix Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: pcre jit disabled Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: detected number of CPU cores: 4 Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: current working directory: / Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: detected binary path: /usr/bin/uwsgi-core Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: your processes number limit is 47680 Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: your memory page size is 4096 bytes Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: detected max file descriptor number: 2048 Aug 23 08:16:14.120826 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: lock engine: pthread robust mutexes Aug 23 08:16:14.122399 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: thunder lock: enabled Aug 23 08:16:14.122399 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 08:16:14.122399 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 08:16:14.161314 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: Python main interpreter initialized at 0x5611abe559c0 Aug 23 08:16:14.161314 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: python threads support enabled Aug 23 08:16:14.161314 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: your server socket listen backlog is limited to 100 connections Aug 23 08:16:14.161314 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: your mercy for graceful operations on workers is 90 seconds Aug 23 08:16:14.161790 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 08:16:14.161790 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: *** Operational MODE: preforking *** Aug 23 08:16:14.162030 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: *** uWSGI is running in multiple interpreter mode *** Aug 23 08:16:14.162030 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: spawned uWSGI master process (pid: 121361) Aug 23 08:16:14.162233 dv-cinder-854070-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 23 08:16:14.163979 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: spawned uWSGI worker 1 (pid: 121382, cores: 1) Aug 23 08:16:14.164343 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: spawned uWSGI worker 2 (pid: 121383, cores: 1) Aug 23 08:16:14.164464 dv-cinder-854070-4-iscsi devstack@n-api.service[121361]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 08:16:14.819444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 08:16:14.825211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 08:16:15.981463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 08:16:15.981463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: from cryptography.utils import int_from_bytes Aug 23 08:16:15.982230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 08:16:15.982230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: from cryptography.utils import int_from_bytes Aug 23 08:16:15.992795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 08:16:15.992795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: from cryptography.utils import int_from_bytes Aug 23 08:16:15.993359 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 08:16:15.993359 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: from cryptography.utils import int_from_bytes Aug 23 08:16:18.432870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 08:16:18.433431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 08:16:18.433741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 08:16:18.434029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 08:16:18.434286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 08:16:18.434717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.435075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.435401 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.435735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.436206 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.436520 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.436846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.437171 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.437502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.437765 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.438085 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.438411 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854070-4-iscsi {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.438735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.439072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.439388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.439708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.440273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.440598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.440908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.441410 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.442684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.442684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.442684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.442923 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.443151 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.443417 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.443751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.444063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.444388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.444698 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.445040 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 08:16:18.445442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854070-4-iscsi {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.445531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 08:16:18.445611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.445689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.445903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 08:16:18.446030 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.446212 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 08:16:18.446414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.446522 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 08:16:18.446720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.446845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.447072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.447199 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.447375 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.447480 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.447679 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.447806 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.447996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.448244 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.448498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.448706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.448951 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.449159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.449403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.449603 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.449793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.449975 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.450137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.450338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.450490 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.450635 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.450787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.450970 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854070-4-iscsi {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.451167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.451335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.451491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.451655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.451809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.451809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.452105 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.452251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.452403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.452592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.452820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.452978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.453140 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.453285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.453464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.453633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.453633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.453969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.454143 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.454300 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.454447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.454602 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.454759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.454917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.455167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.455319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.455494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.455641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.455800 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.455946 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.456092 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.456238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.456392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.456545 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.456700 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.456854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.457007 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.457162 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.457329 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.457329 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.458062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854070-4-iscsi {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.458219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.458396 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.458552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.458698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.458859 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.459089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.459254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.459411 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.459559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.459721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.459879 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.460037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.460183 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.460329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.460482 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.460642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.460797 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.460953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.461106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.461262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.461422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.461584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.461740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.461896 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.462048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.462201 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.462359 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.462513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.462788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.463017 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.463172 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.463317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.463516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.463671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.463819 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.463982 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.464129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.464274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.464437 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.464593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.464737 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.464881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.465033 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.465179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.465342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.465496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.465652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.466329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.466490 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.466646 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.466804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.466968 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.467133 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.467287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.467442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.467598 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.468099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.468262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.468418 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.468576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.468748 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.468896 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.469069 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.469285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.469445 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.469599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.469761 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.469907 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.470052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.470205 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.470360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.470506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.470672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.470820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.471001 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.471153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.471299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.471462 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.471618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.471772 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.471919 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.472078 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.472241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.472241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.472526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.472526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.472823 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.472979 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.473126 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.473126 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.473514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.473662 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.473817 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.473964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.474110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.474271 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.474465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.474615 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.474781 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.474935 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.475129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.475286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.475432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.475585 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.475748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.475902 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.476049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.476201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.476347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.477854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.478353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.478529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.478685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.478840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.479015 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.479182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.479573 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.479733 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.479888 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.480042 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.480190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.480344 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.480491 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.480643 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.480811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.480957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.481111 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.481278 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.482088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.482238 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.482385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.482532 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.482677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.482832 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.483092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.483257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.483417 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.483573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.483728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.483888 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.484035 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.484188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.484342 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.484498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.484731 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.484887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.485033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.485186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.485340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.485498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.485655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.485802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.485955 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.486110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.486264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.486411 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.486570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.486723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.486881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.487063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.487258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.487439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.487589 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.487741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.487887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.487887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.488529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.488693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.488847 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.488995 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.489150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.489298 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.489451 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.489689 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.489853 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.489999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.490155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.490310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.490464 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.490610 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.490763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.490917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.491141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.491289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.491434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.491587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.491741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.491906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.492075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.492821 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.492980 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.493127 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.493284 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.493448 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.493611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.493766 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.493913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.494058 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.494214 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.494371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.494528 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.494674 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.494831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.495012 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.495180 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.495327 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.495518 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.495669 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.495814 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.495968 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.496114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.496267 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 08:16:18.496433 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.496593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.496740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.496886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.497064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.497211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.497377 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.497532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.497685 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.497839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.497987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.498143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.498664 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.498837 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.499023 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.499187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.499341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.499497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.499661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.499885 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.500046 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.500201 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.500348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.500508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.500665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.500811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.500978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.500978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.501265 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.501423 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.501571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.501716 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.501862 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.502021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.502181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.502329 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.502484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.502637 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.502784 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.502964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.503134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.503335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.503487 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.503633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.503778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.503931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.504092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.504239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.504385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.504538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.504686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.504851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.505011 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.505158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.505312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.505767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.505929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.506090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.506246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.506394 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.506539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.506684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.506837 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.507043 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.507206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.507360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.507518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.507665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.507665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.507967 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.508124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.508271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.508787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.508948 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.509105 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.509268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.509422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.509585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.509731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.509903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.510134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.510292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.510448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.510604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.510752 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.511435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.511606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.511757 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.511910 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.512086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.512234 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.512387 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.512579 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.512734 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.512897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.513044 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.513189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.513335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.513562 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.513711 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.513864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.514011 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.514180 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.514334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.514491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.514637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.514785 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.514996 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.515151 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.515310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.515458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.515612 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.515758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.515919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.516080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.516258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.516412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.516564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.516716 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.516866 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.517025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.517191 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.517345 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.517505 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.517665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.517817 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.517970 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.518141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.518304 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.518456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.518627 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.519164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.519333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.519494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.519656 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.519819 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.519972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.520150 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.520387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.520593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.520750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.520913 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.521074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.521235 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.521399 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.521552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.521711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.521864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.522029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.522193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.522361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.522521 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.522674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.522844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.523047 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.523220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.523373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.523525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.523678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.523830 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.523990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.524151 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.524316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.524479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.524630 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.524781 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.524950 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.525113 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.525266 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.525417 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.525577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.525737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.525896 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.526062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.526222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.526633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.526801 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.526983 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.527163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.527330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.527527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.527685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.527845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.528006 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.528680 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.529216 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.529387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.529542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.529701 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.529854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.530015 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.530176 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.530444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.530614 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.530769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.530921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.531121 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.531276 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.531436 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.531598 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.531758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.531920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.532083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.532245 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.532409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.532561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.532721 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.532884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.533037 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.533188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.533347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.533500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.533660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.533828 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.534071 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.534226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.534378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.534547 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.534702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.534868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.535045 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.535209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.535363 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.535363 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.535674 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.535829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.535981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.536133 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.536292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.536452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.536630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.536784 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.540161 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.540350 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.540623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.540791 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.540964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.541130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.541292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.541447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.541608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.541770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.541939 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.542125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.542287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.542448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.542609 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.542769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.542932 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.543186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.543341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.543494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.543653 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.544430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.544604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.544758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.544931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.545093 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.545249 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.545415 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.545576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.545729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.545880 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.546039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.546198 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.546366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.546520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.546671 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.546848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.547030 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.547197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.547365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.547526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.547679 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.547839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.548000 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.548167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.548320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.548482 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.548634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.548786 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.548955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.549217 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.549771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.549934 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.550094 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.550247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.550399 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.550561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.550813 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.550813 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.551706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.551870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.552024 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.552216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.552379 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.552540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.552693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.552846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.553008 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.553161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.553313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.553471 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.553634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.553793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.553960 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.554121 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.554286 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.554438 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.554597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.554751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.554912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.554912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.555249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.555405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.555557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.555716 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.555879 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.556039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.556210 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.556363 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.556513 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.556676 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.556829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.556981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.557139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.557301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.557461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.557622 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.557622 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.557954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.557954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.558413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.558575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.558752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.558920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.559120 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.559286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.559478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.560003 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.560167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.560320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.560473 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.560638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.560811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.561045 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.561211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.561365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.561525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.561687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.561851 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.562006 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.562164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.562320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.562511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.562819 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.563022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.563183 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.563349 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.563502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.563668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.563822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.563992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.564154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.564308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.564460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.564622 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.564777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.565188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.565355 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.565510 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.565681 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.565845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.566006 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.566169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.566331 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.566486 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.566638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.566801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.566997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.567169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.567325 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.567478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.567650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.567812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.567990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.568672 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.568844 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.568999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.569167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.569330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.569484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.569637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.570152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.570324 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.570497 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.570497 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.570815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.570998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.571246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.571412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.571586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.571748 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.571902 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.572054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.572217 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.572385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.572540 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.572693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.572693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.572995 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.573155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.573337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.573615 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.573794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.573951 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.574117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.574271 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.574425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.574624 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.574781 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.575073 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.575247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.575402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.575554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.575718 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.575872 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.576039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.576209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.576369 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.576531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.576685 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.576844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.577007 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.577181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.577336 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.577497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.577657 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.577820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.577988 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.578142 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.578294 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.578447 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.578598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.578765 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.578927 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.579301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.579491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.579660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.579816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.580410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.580657 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.580875 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.581136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.581504 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.581714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.581910 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.582107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.582302 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.582502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.582713 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.582912 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.583132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.583333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.583333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.583687 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.583855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.584095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.584261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.584426 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.584590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.584755 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.584963 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.585139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.585353 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.585519 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.585708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.585871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.586031 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.586202 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.586357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.586516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.586681 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.586681 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.586681 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.586681 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.587376 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.587536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.587696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.587858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.587858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.588169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.588330 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.588489 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.588660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.588821 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.589039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.589209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.589411 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.589577 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.589740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.589894 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.590094 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.590638 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.591407 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.591651 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.591818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.592034 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.592209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.592407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.592570 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.592824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.593036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.593279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.593483 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.593665 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.594519 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.594745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.594965 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.595237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.595438 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.595600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.595814 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.595996 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.596249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.596440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.596628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.596819 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.597199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.597366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.597977 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.598182 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.598370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.598533 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.598817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.598817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.599314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.599573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.599761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.599966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.600132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.600334 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.600922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.601204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.601394 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.601556 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.601826 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.602044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.602044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.602488 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.602661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.602848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.603071 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.603258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.603477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.603664 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.603856 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604023 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604213 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.604386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.605722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.605722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.605722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.605722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.606745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.607038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.607280 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.607502 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.607744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.607978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.608173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.608396 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.608396 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.608818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.609046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.609379 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.609663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.609849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.610046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.610263 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.610472 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.611031 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.611031 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.611438 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.611619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.611829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.612103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.612334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.612513 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.612715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.612928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.613125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.613291 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.613515 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.613710 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.613911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.614075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.614259 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.614436 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.614705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.614908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.615247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.615247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.615645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.615645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.616049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.616049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.616456 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.616731 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.616939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.617194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.617194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.617590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.617760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.617973 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.618156 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.618343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.618570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.618806 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.619114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.619446 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.619647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.619855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.620090 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.620090 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.620526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.620728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.621251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.621470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.621470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.621832 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.622649 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.622649 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.623054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.623928 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.624198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.624387 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.624573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.624786 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.625020 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.625226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.625451 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.625654 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.625853 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.626040 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.626040 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.626418 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.626729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.627053 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.627254 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.627742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.627943 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.628173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.628383 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.628586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.628833 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.629037 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.629256 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.629522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.629724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.629954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.630135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.630347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.630535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.630535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.631460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.631690 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.631867 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.632078 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.632267 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.632451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.632655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.632980 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.633195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.633376 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.633561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.633794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.633794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.634257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.634448 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.634657 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.634874 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.635077 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.635262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.635449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.635622 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.635845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.636052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.636227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.636395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.636395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.636707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.636871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.636871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.637289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.637444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.638228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.638523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.638745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.638972 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.639156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.639321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.639486 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.639685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.640078 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.640309 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.640482 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.640667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.640847 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.641045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.641678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642077 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642077 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642263 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.642949 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643057 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643158 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643158 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643337 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643531 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643628 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643933 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.643933 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644205 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644396 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644574 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644668 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644755 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.644945 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645033 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645118 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645278 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645383 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645383 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645859 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.645954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646053 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646148 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646614 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646614 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.646863 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647464 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647551 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647669 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647856 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.647944 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648028 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648311 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648398 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648856 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.648941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649297 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649297 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649723 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.649997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650179 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650544 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650817 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.650817 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651000 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651000 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651157 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651260 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651504 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651780 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651866 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.651966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652168 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652643 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.652925 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653281 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653381 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653468 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653647 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.653748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654647 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.654910 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655574 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655669 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655755 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.655949 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656231 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656330 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656611 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656792 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656877 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.656969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657334 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657424 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657508 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657784 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.657925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.658022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.658116 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.658220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.658314 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.658720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.658819 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.658906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659076 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.659879 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660488 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660574 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660843 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.660946 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661044 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661517 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661609 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661861 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.661948 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662037 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662130 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662217 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662303 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662785 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.662990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663196 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663196 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663380 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663469 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663663 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663853 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663940 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.663940 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664447 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664539 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.664911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665871 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.665950 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666023 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666100 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666492 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666492 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666842 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.666920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667212 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667291 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667515 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667675 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667755 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667755 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.667987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668061 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668138 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668288 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668521 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668602 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668674 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.668937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669088 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669236 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669916 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.669986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670379 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670537 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.670886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.671947 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672675 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.672922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673160 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673610 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673877 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.673971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.674155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.674249 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.674475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.674561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.674900 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.675076 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.675169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.675244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.675479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.675581 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.675795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.675898 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.676119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.676222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.676444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.676579 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.676787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.676894 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.677101 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.677194 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.677418 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.677518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.677735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.677849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.678056 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.678159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.678403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.678498 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.678732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.678841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.679089 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.679207 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.679414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.679516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.679739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.679834 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.680057 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.680169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.680372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.680475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.680687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.680975 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.681084 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.681313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.681425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.681638 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.681747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.681958 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.682091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.682270 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.682375 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.682623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.682727 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.683012 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.683112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.683309 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.683404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.683643 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.683747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.683968 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.684126 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.684288 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.684397 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.685123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.685221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.685440 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.685533 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.685758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.685852 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.686071 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.686163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.686390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.686489 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.686708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.686818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.687048 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.687158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.687368 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.687463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.687686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.687795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.688000 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.688119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.688310 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.688415 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.688624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.688777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.688943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.689046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.689256 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.689350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.689563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.689737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.689870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.690278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.690453 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.690587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.690760 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.690870 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.691092 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.691195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.691402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.691512 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.691711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.691816 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.692170 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.692291 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.692383 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.692470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.692621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.692727 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.692926 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.693054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.693232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.693370 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.693540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.693805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.693902 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.694128 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.694223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.694436 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.694531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.694741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.694845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.695072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.695236 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.695390 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.695538 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.695693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.695843 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.695987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.696139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.696303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.696453 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.696621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.696772 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.696945 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.697163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.697308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.697458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.697600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.697751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.697894 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.698046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.698188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.698347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.698499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.698651 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.698801 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.698972 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.699109 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.699214 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.699442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.699544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.699758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.699862 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.700118 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.700702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.700930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.701041 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.701246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.701341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.701562 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.701670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.701871 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.701968 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.702188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.702292 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.702509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.702624 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.702814 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.702919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.703149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.703245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.703461 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.703555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.703772 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.703876 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.704084 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.704238 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.704395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.704499 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.704702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.704810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.705016 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.705110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.705327 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.705433 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.705638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.705742 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.705946 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.706039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.706256 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.706358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.706566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.706670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.706876 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.707003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.707220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.707323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.707538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.707645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.707855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.707959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.708186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.708279 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.708511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.708604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.708825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.708928 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.709151 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.709254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.709476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.709581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.709794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.709887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.710110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.710214 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.710450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.710544 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.710769 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.710910 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.711111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.711225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.711428 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.711520 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.711736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.711841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.711977 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121382) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 08:16:18.712089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.712350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.712689 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.713022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.713333 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.713663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.713988 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.714315 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.714636 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.714986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.715310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.715628 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.715975 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.716295 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.716613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.716930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.717253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.717569 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.717886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.718207 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.718615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.718866 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.719226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.719543 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.719877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.720210 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.720562 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.720949 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.721234 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.721566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.721887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.722205 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.722525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 08:16:18.722775 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121383) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 08:16:18.774249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO dbcounter [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Registered counter for database nova_api Aug 23 08:16:18.785180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO dbcounter [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Registered counter for database nova_api Aug 23 08:16:18.795136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_db.sqlalchemy.engines [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:16:18.801793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writer thread running {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:16:18.805809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:16:18.813053 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writer thread running {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:16:18.858424 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.context [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cfa477d1-7cac-413e-8fa7-186dfaa13509(cell1) {{(pid=121382) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 08:16:18.862479 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:16:18.862974 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:16:18.864544 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:16:18.865274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:16:18.865732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:16:18.867739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:16:18.869387 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.context [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cfa477d1-7cac-413e-8fa7-186dfaa13509(cell1) {{(pid=121383) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 08:16:18.869711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO dbcounter [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Registered counter for database nova_cell0 Aug 23 08:16:18.873988 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:16:18.874395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO dbcounter [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Registered counter for database nova_cell1 Aug 23 08:16:18.874530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:16:18.876123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:16:18.877516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:16:18.877980 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:16:18.880029 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:16:18.881608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_db.sqlalchemy.engines [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:16:18.882097 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO dbcounter [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Registered counter for database nova_cell0 Aug 23 08:16:18.883440 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_db.sqlalchemy.engines [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:16:18.886271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO dbcounter [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Registered counter for database nova_cell1 Aug 23 08:16:18.889875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writer thread running {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:16:18.891207 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writer thread running {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:16:18.893589 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:16:18.895379 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:16:18.901330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writer thread running {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:16:18.902959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writer thread running {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:16:19.036488 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO dbcounter [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Registered counter for database nova_cell0 Aug 23 08:16:19.043235 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_db.sqlalchemy.engines [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121382) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:16:19.048837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writer thread running {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:16:19.050167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO dbcounter [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Registered counter for database nova_cell0 Aug 23 08:16:19.056756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_db.sqlalchemy.engines [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121383) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 08:16:19.061797 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writer thread running {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 08:16:19.368484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: WARNING keystonemiddleware.auth_token [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 08:16:19.375814 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: WARNING keystonemiddleware.auth_token [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 08:16:19.380113 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: WARNING keystonemiddleware.auth_token [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 08:16:19.387065 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: WARNING keystonemiddleware.auth_token [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 08:16:19.719086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: WARNING keystonemiddleware.auth_token [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 08:16:19.725127 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: WARNING keystonemiddleware.auth_token [None req-7a36269b-a33b-4a98-8f98-9e2c273d0e0d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 08:16:19.730469 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5611abe559c0 pid: 121382 (default app) Aug 23 08:16:19.731174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: WARNING keystonemiddleware.auth_token [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 08:16:19.737249 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: WARNING keystonemiddleware.auth_token [None req-b9a6653a-6b78-428e-afbc-c39664cb40da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 08:16:19.742840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5611abe559c0 pid: 121383 (default app) Aug 23 08:16:55.026520 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:16:55.028176 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:16:55.029237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:16:55.030063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:16:56.069818 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:16:56.071632 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:16:56.072458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:16:56.073623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:16:56.366960 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-97ff351e-a29a-4123-b438-da37bc78b4ab tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Action: 'create', calling method: .version_select at 0x7fa61bf915e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037171096", "metadata": {"Type": "work"}}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-97ff351e-a29a-4123-b438-da37bc78b4ab tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Request method failure captured: Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 122 Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz2wBpFsuONCsD8hiecKmhWNHr_ZNVlOHvq0JVTW22IwceOebQaHkhoyqL4PAbrBwK8Z5lfH3exaTE07MEqBblB_Db8SNSI6GnrNABg4OOWv0pRj-Dy4jE0NqNo1advPb_ATD2XDM449BZEUlntb4-MtXk7Srl9qY44-h0z6VNBymo Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:16:56.373649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c49d93c1beec4a329469f8f8d75d9af0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 5305d30dae344365b84d9d79dbb24338 Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1037171096", "metadata": {"Type": "work"}}} Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:16:56.375389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1037171096', 'metadata': {'Type': 'work'}}}} Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise error Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi '#$%' Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:16:56.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 08:16:56.377547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 08:16:56.378693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 08:16:56.378693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.380099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-97ff351e-a29a-4123-b438-da37bc78b4ab tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:16:56.381273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-97ff351e-a29a-4123-b438-da37bc78b4ab tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.368205 Aug 23 08:16:56.382327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Aug 23 08:16:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:16:56.395325 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d29dc8ce-504d-41a5-bfdc-fde859fa8500 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Action: 'create', calling method: .version_select at 0x7fa61bf91670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-287316238", "metadata": {"Type": "work"}}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d29dc8ce-504d-41a5-bfdc-fde859fa8500 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Request method failure captured: Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 119 Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz2wBpFsuONCsD8hiecKmhWNHr_ZNVlOHvq0JVTW22IwceOebQaHkhoyqL4PAbrBwK8Z5lfH3exaTE07MEqBblB_Db8SNSI6GnrNABg4OOWv0pRj-Dy4jE0NqNo1advPb_ATD2XDM449BZEUlntb4-MtXk7Srl9qY44-h0z6VNBymo Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:16:56.400455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c49d93c1beec4a329469f8f8d75d9af0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 5305d30dae344365b84d9d79dbb24338 Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-287316238", "metadata": {"Type": "work"}}} Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:16:56.401817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-287316238', 'metadata': {'Type': 'work'}}}} Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise error Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi '0' Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:16:56.402702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 08:16:56.404243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 08:16:56.405414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 08:16:56.405414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.405414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d29dc8ce-504d-41a5-bfdc-fde859fa8500 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:16:56.405414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d29dc8ce-504d-41a5-bfdc-fde859fa8500 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013561 Aug 23 08:16:56.405414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 2/2] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Aug 23 08:16:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 08:16:56.419030 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1ac2f7cb-b48c-496d-857c-5c7390bee888 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Action: 'create', calling method: .version_select at 0x7fa61beca1f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-747500737", "metadata": {"Type": "work"}}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1ac2f7cb-b48c-496d-857c-5c7390bee888 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Request method failure captured: Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 118 Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz2wBpFsuONCsD8hiecKmhWNHr_ZNVlOHvq0JVTW22IwceOebQaHkhoyqL4PAbrBwK8Z5lfH3exaTE07MEqBblB_Db8SNSI6GnrNABg4OOWv0pRj-Dy4jE0NqNo1advPb_ATD2XDM449BZEUlntb4-MtXk7Srl9qY44-h0z6VNBymo Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:16:56.424750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c49d93c1beec4a329469f8f8d75d9af0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 5305d30dae344365b84d9d79dbb24338 Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-747500737", "metadata": {"Type": "work"}}} Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:16:56.426313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-747500737', 'metadata': {'Type': 'work'}}}} Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise error Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi '' Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:16:56.427224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 08:16:56.428596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 08:16:56.429714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 08:16:56.429714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:56.430063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1ac2f7cb-b48c-496d-857c-5c7390bee888 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:16:56.431606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1ac2f7cb-b48c-496d-857c-5c7390bee888 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022432 Aug 23 08:16:56.436456 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 3/3] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Aug 23 08:16:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:16:56.553657 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ea322eb3-dc9d-4c4f-b91e-9027f642ab5d tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Action: 'create', calling method: .version_select at 0x7fa61becab80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1314423343"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:16:57.227002 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-76868088-efd8-4583-89da-2ae78757bc23 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Action: 'create', calling method: .version_select at 0x7fa61bf935e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1718552238", "metadata": {"Type": "work"}}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:16:59.139385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ea322eb3-dc9d-4c4f-b91e-9027f642ab5d tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.704966 Aug 23 08:16:59.155259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 4/4] 10.222.0.58 () {60 vars in 1155 bytes} [Tue Aug 23 08:16:56 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2722 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 08:16:59.160664 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-915ec4b9-dc9c-408d-908a-97c34d644abe tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Calling method '.version_select at 0x7fa61be1faf0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:16:59.590566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-915ec4b9-dc9c-408d-908a-97c34d644abe tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] HTTP exception thrown: Volume tempest-invalid-1514033957 could not be found. Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-915ec4b9-dc9c-408d-908a-97c34d644abe tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Request method failure captured: Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1514033957 HTTP/1.1 Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz2wBpFsuONCsD8hiecKmhWNHr_ZNVlOHvq0JVTW22IwceOebQaHkhoyqL4PAbrBwK8Z5lfH3exaTE07MEqBblB_Db8SNSI6GnrNABg4OOWv0pRj-Dy4jE0NqNo1advPb_ATD2XDM449BZEUlntb4-MtXk7Srl9qY44-h0z6VNBymo Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:16:59.598112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c49d93c1beec4a329469f8f8d75d9af0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 5305d30dae344365b84d9d79dbb24338 Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Volume tempest-invalid-1514033957 could not be found. Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'tempest-invalid-1514033957'} Aug 23 08:16:59.599239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1514033957 could not be found. (HTTP 404) (Request-ID: req-b9167ad1-c24b-4883-8889-ecc95a8df1e2) Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:59.599846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 08:16:59.600723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1514033957 could not be found. Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:16:59.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1514033957 could not be found. Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1514033957 could not be found. Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-915ec4b9-dc9c-408d-908a-97c34d644abe tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Returning 404 to user: Volume tempest-invalid-1514033957 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-915ec4b9-dc9c-408d-908a-97c34d644abe tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1514033957" status: 404 len: 99 microversion: 2.1 time: 0.443121 Aug 23 08:16:59.602473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 5/5] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Aug 23 08:16:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1514033957 => generated 99 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 08:16:59.618369 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9cc3bd78-7103-433f-a701-5e53aa28f434 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61beca1f0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:16:59.652422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-76868088-efd8-4583-89da-2ae78757bc23 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.591523 Aug 23 08:16:59.654166 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 1/6] 10.222.0.58 () {60 vars in 1156 bytes} [Tue Aug 23 08:16:56 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3598 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 23 08:16:59.660941 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3da10979-70bf-4300-9e9a-d525a8e417b3 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005350 Aug 23 08:16:59.665637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 2/7] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Aug 23 08:16:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 08:16:59.698897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-212c478c-f048-4783-b8aa-d2b85e35c790 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011281 Aug 23 08:16:59.700947 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 3/8] 10.222.0.58 () {58 vars in 1137 bytes} [Tue Aug 23 08:16:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 08:16:59.716881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-859837da-2a2c-4d57-9ba6-6be70b83b72f tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61be63940>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:16:59.780645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9cc3bd78-7103-433f-a701-5e53aa28f434 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b" status: 200 len: 345 microversion: 2.1 time: 0.179346 Aug 23 08:16:59.784509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 6/9] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:16:59 2022] GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b => generated 345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:16:59.795545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7dd4786a-56bc-4b90-a2be-3f03f7dcdbca tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Calling method '.version_select at 0x7fa61bdf91f0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:16:59.917646 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-859837da-2a2c-4d57-9ba6-6be70b83b72f tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 353 microversion: 2.1 time: 0.215307 Aug 23 08:16:59.919354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 4/10] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:16:59 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 353 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:16:59.957199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-7dd4786a-56bc-4b90-a2be-3f03f7dcdbca tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] HTTP exception thrown: Volume 36fde7ee-b306-45e7-87f5-a1b3f794fe88 could not be found. Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7dd4786a-56bc-4b90-a2be-3f03f7dcdbca tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Request method failure captured: Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: DELETE /compute/v2.1/os-volumes/36fde7ee-b306-45e7-87f5-a1b3f794fe88 HTTP/1.1 Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz2wBpFsuONCsD8hiecKmhWNHr_ZNVlOHvq0JVTW22IwceOebQaHkhoyqL4PAbrBwK8Z5lfH3exaTE07MEqBblB_Db8SNSI6GnrNABg4OOWv0pRj-Dy4jE0NqNo1advPb_ATD2XDM449BZEUlntb4-MtXk7Srl9qY44-h0z6VNBymo Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:16:59.959967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c49d93c1beec4a329469f8f8d75d9af0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 5305d30dae344365b84d9d79dbb24338 Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesNegativeTest-399824820-project Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Volume 36fde7ee-b306-45e7-87f5-a1b3f794fe88 could not be found. Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '36fde7ee-b306-45e7-87f5-a1b3f794fe88'} Aug 23 08:16:59.961202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36fde7ee-b306-45e7-87f5-a1b3f794fe88 could not be found. (HTTP 404) (Request-ID: req-e1f6a237-4d8c-41ed-bee7-de95dc6de1d9) Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:59.961941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 08:16:59.964228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36fde7ee-b306-45e7-87f5-a1b3f794fe88 could not be found. Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 08:16:59.965152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36fde7ee-b306-45e7-87f5-a1b3f794fe88 could not be found. Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36fde7ee-b306-45e7-87f5-a1b3f794fe88 could not be found. Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7dd4786a-56bc-4b90-a2be-3f03f7dcdbca tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Returning 404 to user: Volume 36fde7ee-b306-45e7-87f5-a1b3f794fe88 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7dd4786a-56bc-4b90-a2be-3f03f7dcdbca tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/36fde7ee-b306-45e7-87f5-a1b3f794fe88" status: 404 len: 109 microversion: 2.1 time: 0.174928 Aug 23 08:16:59.969163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 7/11] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:16:59 2022] DELETE /compute/v2.1/os-volumes/36fde7ee-b306-45e7-87f5-a1b3f794fe88 => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:16:59.976520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7510565f-8656-4cfc-8729-527ae38788a3 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Calling method '.version_select at 0x7fa61be80040>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:00.173474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-7510565f-8656-4cfc-8729-527ae38788a3 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] HTTP exception thrown: Volume 19d57b8a-1d79-448a-87cf-ca2598378735 could not be found. Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7510565f-8656-4cfc-8729-527ae38788a3 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Request method failure captured: Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/os-volumes/19d57b8a-1d79-448a-87cf-ca2598378735 HTTP/1.1 Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBIz2wBpFsuONCsD8hiecKmhWNHr_ZNVlOHvq0JVTW22IwceOebQaHkhoyqL4PAbrBwK8Z5lfH3exaTE07MEqBblB_Db8SNSI6GnrNABg4OOWv0pRj-Dy4jE0NqNo1advPb_ATD2XDM449BZEUlntb4-MtXk7Srl9qY44-h0z6VNBymo Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:17:00.179075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c49d93c1beec4a329469f8f8d75d9af0", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c49d93c1beec4a329469f8f8d75d9af0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-VolumesNegativeTest-399824820 Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: c49d93c1beec4a329469f8f8d75d9af0 Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-VolumesNegativeTest-399824820 Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-VolumesNegativeTest-399824820-project Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: 5305d30dae344365b84d9d79dbb24338 Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-VolumesNegativeTest-399824820-project Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Volume 19d57b8a-1d79-448a-87cf-ca2598378735 could not be found. Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '19d57b8a-1d79-448a-87cf-ca2598378735'} Aug 23 08:17:00.180264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19d57b8a-1d79-448a-87cf-ca2598378735 could not be found. (HTTP 404) (Request-ID: req-6e18cad7-01c1-4861-8f57-07ce54f20061) Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:00.181106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:00.182167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19d57b8a-1d79-448a-87cf-ca2598378735 could not be found. Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 08:17:00.183718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19d57b8a-1d79-448a-87cf-ca2598378735 could not be found. Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19d57b8a-1d79-448a-87cf-ca2598378735 could not be found. Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:00.185495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7510565f-8656-4cfc-8729-527ae38788a3 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] Returning 404 to user: Volume 19d57b8a-1d79-448a-87cf-ca2598378735 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:17:00.187669 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7510565f-8656-4cfc-8729-527ae38788a3 tempest-VolumesNegativeTest-399824820 tempest-VolumesNegativeTest-399824820-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/19d57b8a-1d79-448a-87cf-ca2598378735" status: 404 len: 109 microversion: 2.1 time: 0.215627 Aug 23 08:17:00.188804 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 5/12] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:16:59 2022] GET /compute/v2.1/os-volumes/19d57b8a-1d79-448a-87cf-ca2598378735 => generated 109 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:17:00.814352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dc9cb19f-0822-4095-93a3-300641726924 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bdf9f70>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:00.958096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-dc9cb19f-0822-4095-93a3-300641726924 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b" status: 200 len: 346 microversion: 2.1 time: 0.097419 Aug 23 08:17:00.958096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 8/13] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:00 2022] GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:00.959006 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8b382157-fb21-4938-a8e0-c62f779a2435 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Action: 'create', calling method: .version_select at 0x7fa61be80b80>, body: {"snapshot": {"volume_id": "71d22823-8a89-48c4-a234-25492723940b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1226166545"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:00.959678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f5f4e82c-1b01-4522-bcf7-d1a85fb0afae tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61bdf9d30>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:01.072362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f5f4e82c-1b01-4522-bcf7-d1a85fb0afae tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 353 microversion: 2.1 time: 0.144431 Aug 23 08:17:01.073238 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 9/14] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:00 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:01.855331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8b382157-fb21-4938-a8e0-c62f779a2435 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.950848 Aug 23 08:17:01.855901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 6/15] 10.222.0.58 () {60 vars in 1162 bytes} [Tue Aug 23 08:17:00 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:01.871135 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-abbbddd3-68ae-4bc2-a8d6-80834f345d19 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bdf9160>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:01.948155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-abbbddd3-68ae-4bc2-a8d6-80834f345d19 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 287 microversion: 2.1 time: 0.081421 Aug 23 08:17:01.948708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 10/16] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:01 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:17:01.960478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-418a6a44-f9d1-445f-a2f4-794a0e6a0a99 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bde4c10>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:02.074650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-418a6a44-f9d1-445f-a2f4-794a0e6a0a99 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.118492 Aug 23 08:17:02.075878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 7/17] 10.222.0.58 () {58 vars in 1140 bytes} [Tue Aug 23 08:17:01 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:02.093438 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-17fbef95-593a-4cb3-b387-bcbaa0124d73 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bde40d0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:02.095188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2d106e95-162d-441b-b5d4-5deb4785903d tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61be1faf0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:02.154598 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-17fbef95-593a-4cb3-b387-bcbaa0124d73 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 287 microversion: 2.1 time: 0.070013 Aug 23 08:17:02.155180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 8/18] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:02 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:02.257511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2d106e95-162d-441b-b5d4-5deb4785903d tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 354 microversion: 2.1 time: 0.174267 Aug 23 08:17:02.258546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 11/19] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:02 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:02.273208 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-143441df-dbf2-4c24-ac8c-48ba7a17cc83 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61be80ca0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:02.377886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-143441df-dbf2-4c24-ac8c-48ba7a17cc83 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 354 microversion: 2.1 time: 0.109192 Aug 23 08:17:02.378663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 9/20] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:02 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:02.393894 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-98493091-6eb2-4349-b311-9fcc96e26dab tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61be1f940>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:02.687019 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-98493091-6eb2-4349-b311-9fcc96e26dab tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 202 len: 0 microversion: 2.1 time: 0.297736 Aug 23 08:17:02.692772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 12/21] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:17:02 2022] DELETE /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:17:02.698222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-35279465-4065-4f3a-9435-06401563c3f9 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61bdeb940>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:02.805776 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-35279465-4065-4f3a-9435-06401563c3f9 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 353 microversion: 2.1 time: 0.108891 Aug 23 08:17:02.805776 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 10/22] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:02 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:03.167631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ba8ecf36-5eb4-4925-bc97-76609a25478c tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bdf9af0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:03.347398 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ba8ecf36-5eb4-4925-bc97-76609a25478c tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 287 microversion: 2.1 time: 0.184062 Aug 23 08:17:03.347969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 13/23] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:03 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 287 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:03.823042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2f8431ea-0820-4c0f-b971-cb616605dafb tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61be80f70>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:03.974414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2f8431ea-0820-4c0f-b971-cb616605dafb tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 353 microversion: 2.1 time: 0.161293 Aug 23 08:17:03.975153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 11/24] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:03 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:04.360048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e258b171-4266-4a20-9051-3db62235ed06 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bdf9790>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:04.401091 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e258b171-4266-4a20-9051-3db62235ed06 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 287 microversion: 2.1 time: 0.044917 Aug 23 08:17:04.402603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 14/25] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:04 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:04.990419 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7a3a8b45-46b0-4e11-888f-cb4a7e75b23d tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61bde4670>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:05.095654 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7a3a8b45-46b0-4e11-888f-cb4a7e75b23d tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 353 microversion: 2.1 time: 0.110548 Aug 23 08:17:05.096831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 12/26] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:04 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:05.415354 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3507a68b-4ad7-4a3f-9ded-cfeb9f70a36d tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61be08310>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:05.472420 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3507a68b-4ad7-4a3f-9ded-cfeb9f70a36d tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 287 microversion: 2.1 time: 0.061944 Aug 23 08:17:05.473113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 15/27] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:05 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:06.002489 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1744564486", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:06.111613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-be29642e-f795-4042-a62c-bc906dd0cc35 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61bdf9e50>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:06.167490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] validate_networks() for [('e15ce27b-69fc-4c64-88d5-5ba5f87f4649', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:17:06.211230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-be29642e-f795-4042-a62c-bc906dd0cc35 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 353 microversion: 2.1 time: 0.105396 Aug 23 08:17:06.217695 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 16/28] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:06 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:06.486158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ea02c6e5-8640-410f-adf8-8668591d024f tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bdf90d0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:06.557763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ea02c6e5-8640-410f-adf8-8668591d024f tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 287 microversion: 2.1 time: 0.069220 Aug 23 08:17:06.557763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 17/29] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:06 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:17:07.247276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-85903254-78a7-41f8-88fd-5f6d8e086a44 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61be1fa60>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:07.370219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-85903254-78a7-41f8-88fd-5f6d8e086a44 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 200 len: 353 microversion: 2.1 time: 0.147087 Aug 23 08:17:07.371304 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 18/30] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:07 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:07.565320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8bd8168f-38bf-4c39-b7eb-191db410bf7f tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61be08550>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:07.622059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8bd8168f-38bf-4c39-b7eb-191db410bf7f tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 287 microversion: 2.1 time: 0.061576 Aug 23 08:17:07.623086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 19/31] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:07 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:08.353028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:17:08.353524 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:17:08.353927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:17:08.355562 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:17:08.356173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:17:08.388114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bb559974-38d8-4eb6-a9b4-6862f9414912 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Calling method '.version_select at 0x7fa61be1fb80>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:08.425449 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:08.426534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:08.427458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:08.428694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:08.429337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:08.429961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:08.495724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Getting quotas for project cfd891d8d1b7436fabfa2c48019c3565. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:17:08.510823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Getting quotas for user b3c984088c0448f8abc0a0b60b820b3e and project cfd891d8d1b7436fabfa2c48019c3565. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:17:08.536041 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:17:08.540355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:17:08.757218 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e1320573-597b-4ad0-8f02-144e4f5f09da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.014210 Aug 23 08:17:08.764529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 13/32] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:17:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 3016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:17:08.780816 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6fc78d75-82a7-4af4-9e06-d7a4f92328f7 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bde4b80>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:09.038921 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-bb559974-38d8-4eb6-a9b4-6862f9414912 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] HTTP exception thrown: Volume c7384ee2-3714-4cbb-82d2-a1c9634933b7 could not be found. Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bb559974-38d8-4eb6-a9b4-6862f9414912 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Request method failure captured: Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 HTTP/1.1 Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz3ZFRT-dlLF_ohQsW-G73yMekkfxXGigBdv9nQD6Iuv55UsJPDWwj3X5pMKk9onfE1EkWOZADyt6UyVkcBqyvKk_SjXZF6iTocib0WHOAnAp65p_mg2o9GISnWvnbZsnSIE_BVDiS7hUQrHpiaqix1oyt-_owJNQtghtRljf0x4So Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: df0b6e7c14ba4a4eba256ad043f52c5d Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesGetTestJSON-1850100024 Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:17:09.041908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df0b6e7c14ba4a4eba256ad043f52c5d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_df0b6e7c14ba4a4eba256ad043f52c5d", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/df0b6e7c14ba4a4eba256ad043f52c5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/df0b6e7c14ba4a4eba256ad043f52c5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesGetTestJSON-1850100024 Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: df0b6e7c14ba4a4eba256ad043f52c5d Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesGetTestJSON-1850100024 Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesGetTestJSON-1850100024-project Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: e1ad75433eca4c3e8ec6cbc6fa5cc79e Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesGetTestJSON-1850100024-project Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Volume c7384ee2-3714-4cbb-82d2-a1c9634933b7 could not be found. Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'c7384ee2-3714-4cbb-82d2-a1c9634933b7'} Aug 23 08:17:09.047773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c7384ee2-3714-4cbb-82d2-a1c9634933b7 could not be found. (HTTP 404) (Request-ID: req-fe2c47d1-f777-4858-b1d8-65475a619684) Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:09.048546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:09.049557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c7384ee2-3714-4cbb-82d2-a1c9634933b7 could not be found. Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 08:17:09.050463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c7384ee2-3714-4cbb-82d2-a1c9634933b7 could not be found. Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c7384ee2-3714-4cbb-82d2-a1c9634933b7 could not be found. Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bb559974-38d8-4eb6-a9b4-6862f9414912 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] Returning 404 to user: Volume c7384ee2-3714-4cbb-82d2-a1c9634933b7 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bb559974-38d8-4eb6-a9b4-6862f9414912 tempest-VolumesGetTestJSON-1850100024 tempest-VolumesGetTestJSON-1850100024-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7" status: 404 len: 109 microversion: 2.1 time: 0.660662 Aug 23 08:17:09.052080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 20/33] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:08 2022] GET /compute/v2.1/os-volumes/c7384ee2-3714-4cbb-82d2-a1c9634933b7 => generated 109 bytes in 662 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:17:09.062118 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-aa468a6d-5333-4808-8033-c877cf2d06f7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:09.062977 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-aa468a6d-5333-4808-8033-c877cf2d06f7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:09.133898 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6fc78d75-82a7-4af4-9e06-d7a4f92328f7 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 288 microversion: 2.1 time: 0.366578 Aug 23 08:17:09.133898 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 14/34] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:08 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 288 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:09.140135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9895cd17-bf04-48f9-ae6c-f82a561b2ff5 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61b4f2ee0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:09.246973 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-aa468a6d-5333-4808-8033-c877cf2d06f7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:09.271318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-aa468a6d-5333-4808-8033-c877cf2d06f7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1222 microversion: 2.1 time: 0.222611 Aug 23 08:17:09.274388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 21/35] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:09 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1222 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:09.415586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9895cd17-bf04-48f9-ae6c-f82a561b2ff5 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 202 len: 0 microversion: 2.1 time: 0.278625 Aug 23 08:17:09.418013 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 15/36] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Aug 23 08:17:09 2022] DELETE /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:17:09.432675 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a916c580-4d55-4de5-ad34-9975ddc92277 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61bdf9dc0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:09.500638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a916c580-4d55-4de5-ad34-9975ddc92277 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 200 len: 287 microversion: 2.1 time: 0.079107 Aug 23 08:17:09.506159 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 22/37] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:09 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:09.979783 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-23e7389b-ccf8-4afa-8404-94d43ca52133 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'create', calling method: .version_select at 0x7fa61b4f2ca0>, body: {"keypair": {"name": "tempest-keypair-1990101875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMYV2Cx6/8hhOVhietP1Qxb9kNAhTP58JmhpAOgfrlFWxwCGHF46BKmp6VjDO1geg6ry36yEJ9Wx8A6wD+HNsBLJFiYNpLkXsy6PCv1lOE6As69TSyoWCip/FySreVouA=="}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:10.010740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-23e7389b-ccf8-4afa-8404-94d43ca52133 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Getting quotas for project bc3167dc177744959760f39d57937670. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:17:10.015593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-23e7389b-ccf8-4afa-8404-94d43ca52133 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Getting quotas for user ce316aa5c0b54ac99ade6cc4163ee209 and project bc3167dc177744959760f39d57937670. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:17:10.172832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-23e7389b-ccf8-4afa-8404-94d43ca52133 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.727957 Aug 23 08:17:10.172832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 16/38] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Aug 23 08:17:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 729 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 08:17:10.172832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1936706436", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:10.216969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-819872840", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "networks": [{"uuid": "61413e4a-4cf6-452d-a571-513a05d109a2"}]}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:10.313179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] validate_networks() for [('e15ce27b-69fc-4c64-88d5-5ba5f87f4649', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:17:10.495941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] validate_networks() for [('61413e4a-4cf6-452d-a571-513a05d109a2', None, None, None, None, None)] {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:17:11.874526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:17:11.876238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:17:11.877673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:17:11.878312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:17:11.879189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:17:11.926887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:11.932406 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:11.936221 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:11.940591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:11.942538 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:11.944515 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:11.975847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Getting quotas for project cfd891d8d1b7436fabfa2c48019c3565. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:17:11.980898 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:17:11.981412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:17:11.982167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:17:11.982803 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:17:11.983626 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:17:12.010389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Getting quotas for user b3c984088c0448f8abc0a0b60b820b3e and project cfd891d8d1b7436fabfa2c48019c3565. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:17:12.055389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:12.055389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:12.056864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:12.071456 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:12.077663 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:12.082319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:12.090618 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:17:12.105364 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:17:12.222181 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Getting quotas for project 7d310b6c64154e3bb5d95f1e762e3e80. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:17:12.240002 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Getting quotas for user dd81f4241d7343e990aea15e49be5f81 and project 7d310b6c64154e3bb5d95f1e762e3e80. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:17:12.270507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:17:12.277792 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:17:12.334095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0ef93dc6-fea6-41cd-b0da-bcc338ddb2db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.167171 Aug 23 08:17:12.334746 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 17/39] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:17:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:17:12.369571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3e63d1d9-39aa-4026-bd07-8808cb7957e6 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61ac92790>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:12.498840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-3e63d1d9-39aa-4026-bd07-8808cb7957e6 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] HTTP exception thrown: Snapshot d7ab37dd-ede6-4665-b52e-7446e5392806 could not be found. Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3e63d1d9-39aa-4026-bd07-8808cb7957e6 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Request method failure captured: Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 HTTP/1.1 Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBIz4cqYWBC1dh1TvKLEuNoPTQrNNzymUMGn6V2_mrJv80myX0usO4YhsprxdhUIMTjI1G2JYgm98u1DEeMM3fv16qNky6a7KOhk32EncQ45ZeEk6NDTCRWWZ71a-ZoMsN36Y2WFHf3Osdp0vrC2R-ueOC30KNN8N08AZiI2aVf7heoI Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 6e70945a174d4af4abedd30925eb4130 Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:17:12.501283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e70945a174d4af4abedd30925eb4130", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 6e70945a174d4af4abedd30925eb4130 Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-VolumesSnapshotsTestJSON-961631641-project Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: e53e9053a81f4e8884df1e50cd778305 Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-VolumesSnapshotsTestJSON-961631641-project Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Snapshot d7ab37dd-ede6-4665-b52e-7446e5392806 could not be found. Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'd7ab37dd-ede6-4665-b52e-7446e5392806'} Aug 23 08:17:12.502407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d7ab37dd-ede6-4665-b52e-7446e5392806 could not be found. (HTTP 404) (Request-ID: req-a9d7da38-cb9b-4345-94db-bac912878954) Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:12.503119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:12.503978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d7ab37dd-ede6-4665-b52e-7446e5392806 could not be found. Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 23 08:17:12.504893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d7ab37dd-ede6-4665-b52e-7446e5392806 could not be found. Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d7ab37dd-ede6-4665-b52e-7446e5392806 could not be found. Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3e63d1d9-39aa-4026-bd07-8808cb7957e6 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Returning 404 to user: Snapshot d7ab37dd-ede6-4665-b52e-7446e5392806 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:17:12.505881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3e63d1d9-39aa-4026-bd07-8808cb7957e6 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806" status: 404 len: 111 microversion: 2.1 time: 0.150484 Aug 23 08:17:12.511873 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 18/40] 10.222.0.58 () {58 vars in 1251 bytes} [Tue Aug 23 08:17:12 2022] GET /compute/v2.1/os-snapshots/d7ab37dd-ede6-4665-b52e-7446e5392806 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:17:12.525050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-28ddf642-2612-4cee-90cf-ae5649d55026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:12.525969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-28ddf642-2612-4cee-90cf-ae5649d55026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:12.663335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-08c076e4-9bbb-4ad7-896f-9bfef129e3fa tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.918524 Aug 23 08:17:12.664008 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 23/41] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:17:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 08:17:12.683511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6dc752d5-4060-410c-8d35-88b1d6e173f7 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61b4a7a60>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:12.823282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-28ddf642-2612-4cee-90cf-ae5649d55026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:12.854480 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-28ddf642-2612-4cee-90cf-ae5649d55026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1222 microversion: 2.1 time: 0.341066 Aug 23 08:17:12.860912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 19/42] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:12 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1222 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:12.880931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2b23ea2d-3dca-405a-950f-6d5599c883f6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:12.882800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2b23ea2d-3dca-405a-950f-6d5599c883f6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:13.082777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2b23ea2d-3dca-405a-950f-6d5599c883f6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:13.097674 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2b23ea2d-3dca-405a-950f-6d5599c883f6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1214 microversion: 2.1 time: 0.233938 Aug 23 08:17:13.112000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 20/43] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:12 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:13.127429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6dc752d5-4060-410c-8d35-88b1d6e173f7 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b" status: 202 len: 0 microversion: 2.1 time: 0.454976 Aug 23 08:17:13.127429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 24/44] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:17:12 2022] DELETE /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:17:13.134220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-685e101c-935e-4097-b982-4d4d7af23e8e tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61a45f0d0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:13.342086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-685e101c-935e-4097-b982-4d4d7af23e8e tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b" status: 200 len: 345 microversion: 2.1 time: 0.211608 Aug 23 08:17:13.342737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 21/45] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:13 2022] GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b => generated 345 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:13.879332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-288c071b-0be2-4183-a140-536adc77becc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:13.880593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-288c071b-0be2-4183-a140-536adc77becc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:13.988782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-288c071b-0be2-4183-a140-536adc77becc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:13.999104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-288c071b-0be2-4183-a140-536adc77becc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1222 microversion: 2.1 time: 0.124651 Aug 23 08:17:13.999688 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 25/46] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:13 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:14.122462 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9d264a4b-1255-47a1-999b-1d22ff61df3a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:14.123117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9d264a4b-1255-47a1-999b-1d22ff61df3a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:14.228996 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9d264a4b-1255-47a1-999b-1d22ff61df3a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:14.238022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9d264a4b-1255-47a1-999b-1d22ff61df3a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1214 microversion: 2.1 time: 0.119873 Aug 23 08:17:14.251679 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 22/47] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:14 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:14.357828 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ddb29229-ab92-47c6-9098-65d3bffa4004 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61b4c45e0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:15.037427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:15.039667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:15.049357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:15.050668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:15.051288 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:15.053700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:15.055317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:15.055820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:15.327299 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:15.346442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-85a21ac3-8168-4ff9-9348-ca3bc8b0d0d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1226 microversion: 2.1 time: 0.327434 Aug 23 08:17:15.346442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 23/48] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:15 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1226 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:15.350825 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:15.351477 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:15.357930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:15.358613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:15.359241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:15.359961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:15.360425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:15.360852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:15.377645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-ddb29229-ab92-47c6-9098-65d3bffa4004 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] HTTP exception thrown: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ddb29229-ab92-47c6-9098-65d3bffa4004 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Request method failure captured: Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b HTTP/1.1 Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz4cqYWBC1dh1TvKLEuNoPTQrNNzymUMGn6V2_mrJv80myX0usO4YhsprxdhUIMTjI1G2JYgm98u1DEeMM3fv16qNky6a7KOhk32EncQ45ZeEk6NDTCRWWZ71a-ZoMsN36Y2WFHf3Osdp0vrC2R-ueOC30KNN8N08AZiI2aVf7heoI Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 6e70945a174d4af4abedd30925eb4130 Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:17:15.379937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e70945a174d4af4abedd30925eb4130", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 6e70945a174d4af4abedd30925eb4130 Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesSnapshotsTestJSON-961631641-project Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: e53e9053a81f4e8884df1e50cd778305 Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesSnapshotsTestJSON-961631641-project Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '71d22823-8a89-48c4-a234-25492723940b'} Aug 23 08:17:15.381082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. (HTTP 404) (Request-ID: req-043ee1fe-f513-4db3-93bf-5eb5857ba88c) Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.381724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:15.382805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 08:17:15.385202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ddb29229-ab92-47c6-9098-65d3bffa4004 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Returning 404 to user: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:17:15.386906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ddb29229-ab92-47c6-9098-65d3bffa4004 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b" status: 404 len: 109 microversion: 2.1 time: 1.028622 Aug 23 08:17:15.394530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 26/49] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:14 2022] GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b => generated 109 bytes in 1042 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:17:15.409250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2f12ea9a-e2a9-47b8-87ac-bdb2de7bde07 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61b4a7f70>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:15.529193 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-2f12ea9a-e2a9-47b8-87ac-bdb2de7bde07 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] HTTP exception thrown: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2f12ea9a-e2a9-47b8-87ac-bdb2de7bde07 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Request method failure captured: Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: DELETE /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b HTTP/1.1 Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz4cqYWBC1dh1TvKLEuNoPTQrNNzymUMGn6V2_mrJv80myX0usO4YhsprxdhUIMTjI1G2JYgm98u1DEeMM3fv16qNky6a7KOhk32EncQ45ZeEk6NDTCRWWZ71a-ZoMsN36Y2WFHf3Osdp0vrC2R-ueOC30KNN8N08AZiI2aVf7heoI Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 6e70945a174d4af4abedd30925eb4130 Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:17:15.532476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e70945a174d4af4abedd30925eb4130", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 6e70945a174d4af4abedd30925eb4130 Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesSnapshotsTestJSON-961631641-project Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: e53e9053a81f4e8884df1e50cd778305 Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesSnapshotsTestJSON-961631641-project Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '71d22823-8a89-48c4-a234-25492723940b'} Aug 23 08:17:15.536153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. (HTTP 404) (Request-ID: req-1440afcf-5f86-4590-91df-bf429473330b) Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.536913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 08:17:15.537882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 08:17:15.538802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2f12ea9a-e2a9-47b8-87ac-bdb2de7bde07 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Returning 404 to user: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:17:15.539776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2f12ea9a-e2a9-47b8-87ac-bdb2de7bde07 tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b" status: 404 len: 109 microversion: 2.1 time: 0.138883 Aug 23 08:17:15.540452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 27/50] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:17:15 2022] DELETE /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:17:15.554000 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-431fd12c-b9b6-46fd-8de1-f1f15d3c65ae tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Calling method '.version_select at 0x7fa61b4c48b0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:15.589225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:15.604485 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-39ffe441-5d59-494f-bb8e-91b3e2d27764 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1218 microversion: 2.1 time: 0.257368 Aug 23 08:17:15.605444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 24/51] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:15 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:15.667596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-431fd12c-b9b6-46fd-8de1-f1f15d3c65ae tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] HTTP exception thrown: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-431fd12c-b9b6-46fd-8de1-f1f15d3c65ae tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Request method failure captured: Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b HTTP/1.1 Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBIz4cqYWBC1dh1TvKLEuNoPTQrNNzymUMGn6V2_mrJv80myX0usO4YhsprxdhUIMTjI1G2JYgm98u1DEeMM3fv16qNky6a7KOhk32EncQ45ZeEk6NDTCRWWZ71a-ZoMsN36Y2WFHf3Osdp0vrC2R-ueOC30KNN8N08AZiI2aVf7heoI Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 6e70945a174d4af4abedd30925eb4130 Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:17:15.670711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6e70945a174d4af4abedd30925eb4130", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6e70945a174d4af4abedd30925eb4130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 6e70945a174d4af4abedd30925eb4130 Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-961631641 Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesSnapshotsTestJSON-961631641-project Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: e53e9053a81f4e8884df1e50cd778305 Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesSnapshotsTestJSON-961631641-project Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '71d22823-8a89-48c4-a234-25492723940b'} Aug 23 08:17:15.672014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. (HTTP 404) (Request-ID: req-e2946699-fe3f-497d-9e49-d10fde81be6c) Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.672795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 08:17:15.673953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 08:17:15.678699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-431fd12c-b9b6-46fd-8de1-f1f15d3c65ae tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] Returning 404 to user: Volume 71d22823-8a89-48c4-a234-25492723940b could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-431fd12c-b9b6-46fd-8de1-f1f15d3c65ae tempest-VolumesSnapshotsTestJSON-961631641 tempest-VolumesSnapshotsTestJSON-961631641-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b" status: 404 len: 109 microversion: 2.1 time: 0.131321 Aug 23 08:17:15.679794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 28/52] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:15 2022] GET /compute/v2.1/os-volumes/71d22823-8a89-48c4-a234-25492723940b => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:17:15.752303 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-316072237", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09a6fa59-e4cc-4c76-8e34-2eaf4ca225a7"}], "security_groups": [{"name": "tempest-securitygroup--1677218208"}], "key_name": "tempest-keypair-1990101875", "user_data": "}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:16.040774 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] validate_networks() for [('09a6fa59-e4cc-4c76-8e34-2eaf4ca225a7', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:17:16.366289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:16.367377 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:16.373944 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:16.374758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:16.375369 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:16.376212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:16.377663 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:16.379277 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:16.544516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:16.559514 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-162193ac-6bbe-4e84-88eb-955ecf327018 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1218 microversion: 2.1 time: 0.197328 Aug 23 08:17:16.560671 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 29/53] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:16 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:16.629708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:16.630452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:16.637678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:16.638456 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:16.639020 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:16.639825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:16.640388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:16.641561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:16.804570 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:16.817553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-497fbcd4-8207-4332-b88b-e12972efe16f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1210 microversion: 2.1 time: 0.188770 Aug 23 08:17:16.822348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 30/54] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:16 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1210 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:17.044747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:17:17.045509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:17:17.046136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:17:17.046710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:17:17.048403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:17:17.061301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:17.061847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:17.062239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:17.063004 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:17.063465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:17.063897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:17.083189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Getting quotas for project bc3167dc177744959760f39d57937670. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:17:17.087144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Getting quotas for user ce316aa5c0b54ac99ade6cc4163ee209 and project bc3167dc177744959760f39d57937670. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:17:17.099583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:17:17.102886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:17:17.265600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-605d8aa5-d22b-455f-a94e-9d698ebdc406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.520627 Aug 23 08:17:17.266390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 25/55] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Aug 23 08:17:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 08:17:17.278378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f637f4f4-4be1-4d76-8491-909d3a89fcdd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:17.279173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f637f4f4-4be1-4d76-8491-909d3a89fcdd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:17.389646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f637f4f4-4be1-4d76-8491-909d3a89fcdd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:17.399767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f637f4f4-4be1-4d76-8491-909d3a89fcdd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:17.402047 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f637f4f4-4be1-4d76-8491-909d3a89fcdd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:17.403465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f637f4f4-4be1-4d76-8491-909d3a89fcdd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1281 microversion: 2.20 time: 0.129931 Aug 23 08:17:17.404384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 31/56] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:17 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1281 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:17:17.585839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:17.587104 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:17.594767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:17.596516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:17.597248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:17.598274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:17.599088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:17.599726 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:17.696813 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:17.704984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8f6a43bb-13c3-4006-bd57-2e09b458f49d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1274 microversion: 2.1 time: 0.128377 Aug 23 08:17:17.706195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 26/57] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:17 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1274 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:17.847631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:17.848624 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:17.856778 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:17.857274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:17.857717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:17.858419 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:17.858875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:17.859328 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:17.929979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:17.942564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fbb9f823-86ba-4395-a903-90a907f1d885 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1210 microversion: 2.1 time: 0.105292 Aug 23 08:17:17.953439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 32/58] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:17 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1210 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:18.426658 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c66aa5fa-8e9d-4463-8313-3bb3874d9c7c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:18.427320 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c66aa5fa-8e9d-4463-8313-3bb3874d9c7c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:18.491211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c66aa5fa-8e9d-4463-8313-3bb3874d9c7c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:18.497978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c66aa5fa-8e9d-4463-8313-3bb3874d9c7c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:18.499535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c66aa5fa-8e9d-4463-8313-3bb3874d9c7c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:18.500640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c66aa5fa-8e9d-4463-8313-3bb3874d9c7c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1281 microversion: 2.20 time: 0.078525 Aug 23 08:17:18.501215 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 27/59] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:18 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1281 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:18.728843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:18.729537 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:18.735610 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:18.736179 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:18.736817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:18.737580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:18.738130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:18.738631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:18.811738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:18.820436 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-125115d2-115d-4184-ae6c-a6351e8d50bf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1274 microversion: 2.1 time: 0.095564 Aug 23 08:17:18.821011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 33/60] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:18 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1274 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:18.965132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:18.965668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:18.972050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:18.972527 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:18.972961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:18.973642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:18.974093 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:18.974514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:19.035798 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:19.044801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bf2d6604-7917-4fee-bdf8-f44029d2e45b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1210 microversion: 2.1 time: 0.083498 Aug 23 08:17:19.045567 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 28/61] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:18 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:19.528113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:19.528113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:19.534898 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:19.535523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:19.535971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:19.536750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:19.537251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:19.537802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:19.677707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:19.694676 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:19.697605 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:19.699300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a864c598-3c14-432b-8d46-d6e2e98df5f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1285 microversion: 2.20 time: 0.179373 Aug 23 08:17:19.701734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 34/62] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:19 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:19.842613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:19.843563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:19.851092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:19.851659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:19.852221 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:19.852989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:19.853460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:19.853891 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:19.953402 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:19.968592 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8935b4db-b3b7-4744-8492-d9d4c55b9a1b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1274 microversion: 2.1 time: 0.130659 Aug 23 08:17:19.969841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 29/63] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:19 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1274 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:17:20.069311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:20.070023 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:20.076427 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:20.076918 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:20.077953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:20.078287 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:20.078875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:20.079331 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:20.195219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:20.207741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-aa00e897-5461-4b44-a706-f9685a0bb485 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1266 microversion: 2.1 time: 0.145206 Aug 23 08:17:20.231282 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 35/64] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:20 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:20.729229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:20.730278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:20.736828 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:20.737660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:20.738763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:20.739736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:20.740307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:20.740979 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:20.873926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:20.882993 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:20.887946 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:20.891451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8853da8b-c4c8-4fe0-ba52-3c970ff8d789 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1333 microversion: 2.20 time: 0.164414 Aug 23 08:17:20.902020 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-f6cf5f48-37ff-4590-8f78-44b5e2aa02cd req-111c054f-959b-48d1-ae21-4582e81a2080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb12ae3d-e305-4628-a89c-7a6f95c07fa8", "tag": "a1092aaf-fd40-4484-a5b6-c54eedb226c8"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:20.907043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 30/65] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:20 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1333 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:20.945549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f6cf5f48-37ff-4590-8f78-44b5e2aa02cd req-111c054f-959b-48d1-ae21-4582e81a2080 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:20.946393 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f6cf5f48-37ff-4590-8f78-44b5e2aa02cd req-111c054f-959b-48d1-ae21-4582e81a2080 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:20.949428 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f6cf5f48-37ff-4590-8f78-44b5e2aa02cd req-111c054f-959b-48d1-ae21-4582e81a2080 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:20.979333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-f6cf5f48-37ff-4590-8f78-44b5e2aa02cd req-111c054f-959b-48d1-ae21-4582e81a2080 service nova] Creating event network-changed:a1092aaf-fd40-4484-a5b6-c54eedb226c8 for instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 on hv-cinder-85407 Aug 23 08:17:20.980005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f6cf5f48-37ff-4590-8f78-44b5e2aa02cd req-111c054f-959b-48d1-ae21-4582e81a2080 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121382) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 08:17:20.980664 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f6cf5f48-37ff-4590-8f78-44b5e2aa02cd req-111c054f-959b-48d1-ae21-4582e81a2080 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121382) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 08:17:20.981972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:20.982592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:20.983525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:20.984396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:20.985020 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:20.985445 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:20.991093 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:20.991093 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:20.995440 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.compute.rpcapi [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 08:17:20.996335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] Releasing lock "compute-rpcapi-router" {{(pid=121382) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 08:17:21.008637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:21.009131 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:21.015186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:21.016188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:21.019276 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:21.019276 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:21.023512 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-73e840f0-e59d-4274-88e4-8da66dcecbc6 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263841 Aug 23 08:17:21.025955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 36/66] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:21.155952 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:21.178876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0674804b-030a-4475-83c5-12f6af56a841 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1280 microversion: 2.1 time: 0.185892 Aug 23 08:17:21.179561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 31/67] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:20 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1280 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:17:21.234897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:21.235661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:21.249255 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:21.249839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:21.250288 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:21.251093 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:21.253979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:21.254487 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:21.294859 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-813a98df-1d3c-49ae-bff8-25f0211f9731 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61a3623a0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:21.447367 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:21.461976 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b1fbb06f-6e0c-447b-a7f6-9abf2c61478b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1284 microversion: 2.1 time: 0.227671 Aug 23 08:17:21.463418 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 37/68] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:21 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:21.494347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-813a98df-1d3c-49ae-bff8-25f0211f9731 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/0e21606f-25c4-4625-ba20-ec541b856758" status: 200 len: 351 microversion: 2.1 time: 0.210365 Aug 23 08:17:21.495581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 32/69] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:21 2022] GET /compute/v2.1/os-volumes/0e21606f-25c4-4625-ba20-ec541b856758 => generated 351 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:21.913720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:21.914526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:21.930650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:21.934841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:21.935439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:21.936312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:21.938237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:21.941840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:22.148821 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:22.169719 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:22.171353 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:22.173192 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cc9dec18-c0b0-41c6-8ed4-9dbc77c71f6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1339 microversion: 2.20 time: 0.263319 Aug 23 08:17:22.174213 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 38/70] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:21 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1339 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:22.202559 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:22.203351 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:22.218552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:22.219163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:22.221401 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:22.221401 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:22.221401 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:22.221401 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:22.415793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:22.431852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-617d9511-c738-4683-adbb-0cb9ec20ecb1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1280 microversion: 2.1 time: 0.232218 Aug 23 08:17:22.433448 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 33/71] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:22 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1280 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:22.485923 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:22.486798 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:22.498781 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:22.499408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:22.499850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:22.504167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:22.506022 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:22.506565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:22.624935 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:22.703117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-30218bf3-94c7-4ba4-b2ff-1612922d19cf tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1272 microversion: 2.1 time: 0.153542 Aug 23 08:17:22.703117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 39/72] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:22 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1272 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:17:23.206966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:23.207748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:23.218081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:23.219229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:23.220878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:23.222857 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:23.223577 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:23.224455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:23.457089 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:23.458098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:23.458341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:23.470144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:23.470867 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:23.472858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:23.473413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:23.476189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:23.480447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:23.481223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:23.483598 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:23.484949 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9f18cc3e-9a69-4037-8465-0eaa7b41098f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1339 microversion: 2.20 time: 0.292908 Aug 23 08:17:23.511592 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 34/73] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:23 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1339 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:23.725025 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:23.730787 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:23.738818 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:23.739905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:23.740563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:23.741638 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:23.742419 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:23.743626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:24.177834 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:24.186708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f9847c41-369d-45c0-bfe7-082cfd5cc55e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.467966 Aug 23 08:17:24.187341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 35/74] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:23 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:24.442551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:24.457965 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8a422486-6541-4a49-b54c-15ad0f5f37f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 1.005838 Aug 23 08:17:24.461731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 40/75] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:23 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:24.512350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:24.512896 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:24.515936 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:24.523756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:24.527210 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:24.527354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:24.528095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:24.537023 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:24.537770 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:24.928091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:24.939940 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:24.945047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:24.946437 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6799ea6a-f459-4c59-9254-be3020af6f25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.438168 Aug 23 08:17:24.948081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 36/76] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:24 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:25.210374 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:25.211130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:25.217534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.218321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.218791 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:25.219524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.219981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.220520 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:25.381500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8b0fff52-6f19-4e4e-9eba-6eb52ead51e7 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61a34cd30>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:25.450243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:25.471182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-13f5a18c-77b4-4501-aaa2-1a8a1d99e762 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.259722 Aug 23 08:17:25.471182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 41/77] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:25 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:25.485771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:25.486553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:25.489762 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8b0fff52-6f19-4e4e-9eba-6eb52ead51e7 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/00fa555f-eae5-41c1-9fd0-9a3ef2493443" status: 200 len: 351 microversion: 2.1 time: 0.113376 Aug 23 08:17:25.490677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 37/78] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:25 2022] GET /compute/v2.1/os-volumes/00fa555f-eae5-41c1-9fd0-9a3ef2493443 => generated 351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:17:25.506029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.506029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.506029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:25.506029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.506607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.506607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:25.515021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-8f4aa40d-cdaf-42cb-b5e4-93cf7f41894c req-34656517-6a95-487e-b8fa-5d1960ccae03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042d0cf1-0b41-42c7-8eb9-03e48f370ee5", "tag": "9f819a2e-e0a5-48e2-9a38-34bd2a1349c4"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:25.552697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-8f4aa40d-cdaf-42cb-b5e4-93cf7f41894c req-34656517-6a95-487e-b8fa-5d1960ccae03 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.552697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-8f4aa40d-cdaf-42cb-b5e4-93cf7f41894c req-34656517-6a95-487e-b8fa-5d1960ccae03 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.552697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-8f4aa40d-cdaf-42cb-b5e4-93cf7f41894c req-34656517-6a95-487e-b8fa-5d1960ccae03 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:25.578531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-8f4aa40d-cdaf-42cb-b5e4-93cf7f41894c req-34656517-6a95-487e-b8fa-5d1960ccae03 service nova] Creating event network-changed:9f819a2e-e0a5-48e2-9a38-34bd2a1349c4 for instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 on hv-cinder-85407 Aug 23 08:17:25.579423 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-8f4aa40d-cdaf-42cb-b5e4-93cf7f41894c req-34656517-6a95-487e-b8fa-5d1960ccae03 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121383) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 08:17:25.580043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-8f4aa40d-cdaf-42cb-b5e4-93cf7f41894c req-34656517-6a95-487e-b8fa-5d1960ccae03 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121383) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 08:17:25.581190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.581717 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.582213 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:25.583156 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.583773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.584387 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:25.593465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.compute.rpcapi [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 08:17:25.594658 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] Releasing lock "compute-rpcapi-router" {{(pid=121383) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 08:17:25.613463 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-cb3ffe50-4f19-4e45-8d59-7dd240c59ad0 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101915 Aug 23 08:17:25.616997 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 38/79] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:17:25.766976 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:25.787338 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d7e54c1e-36ad-4769-8c50-9e60c5b0ae5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.293798 Aug 23 08:17:25.787338 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 42/80] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:25 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:17:25.973564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:25.974252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:25.982010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.982676 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.983455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:25.984389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:25.984987 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:25.985605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:26.048824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-ee65ce34-0151-4bf6-b198-4ed5e87f49b3 req-70e049ea-66c8-44e2-aa97-66e9ba8c1433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017c13ab-2fa1-46f8-bab7-1308c79c41b0", "tag": "edd2fddc-c817-4def-b863-9892d76cc2ad"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:26.059098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ee65ce34-0151-4bf6-b198-4ed5e87f49b3 req-70e049ea-66c8-44e2-aa97-66e9ba8c1433 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:26.059575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ee65ce34-0151-4bf6-b198-4ed5e87f49b3 req-70e049ea-66c8-44e2-aa97-66e9ba8c1433 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:26.060003 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ee65ce34-0151-4bf6-b198-4ed5e87f49b3 req-70e049ea-66c8-44e2-aa97-66e9ba8c1433 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:26.072180 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-ee65ce34-0151-4bf6-b198-4ed5e87f49b3 req-70e049ea-66c8-44e2-aa97-66e9ba8c1433 service nova] Creating event network-changed:edd2fddc-c817-4def-b863-9892d76cc2ad for instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 on hv-cinder-85407 Aug 23 08:17:26.077920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-ee65ce34-0151-4bf6-b198-4ed5e87f49b3 req-70e049ea-66c8-44e2-aa97-66e9ba8c1433 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094972 Aug 23 08:17:26.078815 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 43/81] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:17:26.155582 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:26.166119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:26.168054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:26.169184 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f25d97cc-8a1e-4dfe-92f3-9d308804ebdf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.200448 Aug 23 08:17:26.169737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 39/82] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:25 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:26.488173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:26.488873 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:26.495533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:26.496015 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:26.496455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:26.497150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:26.497602 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:26.498026 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:26.728963 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:26.736454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3ad98c60-ba4b-41a3-8217-64eb40a4bd3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.253007 Aug 23 08:17:26.736952 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 44/83] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:26 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:26.796063 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:26.796660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:26.803441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:26.803925 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:26.804362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:26.805088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:26.805549 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:26.805977 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:27.145010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:27.153003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c8aaa300-6224-4c77-8169-ca976a74e7b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.361271 Aug 23 08:17:27.153575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 40/84] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:26 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:27.191772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:27.192416 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:27.201683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:27.201683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:27.201683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:27.201683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:27.202011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:27.202011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:27.355068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:27.363308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:27.365309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:27.365887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-59e6e4e9-c5b9-48eb-b9ef-e47ca2b8fd6b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.178061 Aug 23 08:17:27.379102 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 45/85] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:27 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:27.759252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:27.760393 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:27.767946 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:27.770079 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:27.770807 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:27.772168 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:27.772712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:27.773254 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:27.967382 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:27.975961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-07d7b786-71ae-438c-9acf-301ca6f89f3d tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.221814 Aug 23 08:17:27.976545 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 41/86] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:27 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:28.173498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:28.174136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:28.176093 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=12 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:28.180819 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:28.181344 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:28.181770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:28.182439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:28.182881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:28.183321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:28.319505 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:28.332535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0da79edd-3a02-4074-b21d-f7727886c9ab tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.162728 Aug 23 08:17:28.333145 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 46/87] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:28 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:28.389174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:28.389764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:28.396541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:28.397034 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:28.397484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:28.398191 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:28.398653 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:28.399131 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:28.494318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=30 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:28.536426 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:28.540640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:28.545059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:28.546569 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:28.547703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-975eabb3-c52e-485a-a4f5-a5c40d10c95a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.162622 Aug 23 08:17:28.548283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 42/88] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:28 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:28.997656 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:28.998315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:29.004421 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:29.004936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:29.005381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:29.006055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:29.006542 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:29.006978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:29.010979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:29.163372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:29.172264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-513eac3b-b969-406a-a568-d25cb1a363ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.178760 Aug 23 08:17:29.178257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 47/89] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:28 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:29.355025 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:29.355694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:29.363939 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:29.364588 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:29.365200 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:29.366195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:29.366882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:29.367481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:29.506989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:29.515094 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-acff03c0-ed2d-4796-8569-23b4cc73da22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.163804 Aug 23 08:17:29.519389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 43/90] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:29 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:29.571425 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:29.572070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:29.578530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:29.579227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:29.579670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:29.580397 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:29.580852 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:29.581327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:29.772077 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:29.780552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:29.782396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:29.783771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-eee06bdf-98d9-4252-8268-9fc7aa3dee98 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.216202 Aug 23 08:17:29.785884 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 48/91] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:29 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:30.197251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:30.197993 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:30.204701 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:30.205274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:30.205801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:30.207145 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:30.207670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:30.208267 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:30.360810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:30.369386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bb857bb4-2a9b-4009-b8d0-88e0c9b380d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.175952 Aug 23 08:17:30.369969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 44/92] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:30 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:17:30.537193 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:30.537918 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:30.544485 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:30.545055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:30.546395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:30.546395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:30.558609 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:30.559190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:30.736157 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:30.746259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e1c4dbbc-9241-4043-af86-23c0787dc156 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.213638 Aug 23 08:17:30.747213 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 49/93] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:30 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:30.813140 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:30.813764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:30.820021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:30.820709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:30.821310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:30.822201 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:30.827848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:30.828522 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:30.975703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:30.988220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:30.990490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:30.991943 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b6c2230b-aedc-4817-8cf8-6fdabe05b491 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.182873 Aug 23 08:17:30.993109 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 45/94] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:30 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:31.392665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:31.392665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:31.395365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=4 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:31.398792 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:31.399307 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:31.399738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:31.400504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:31.400948 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:31.401531 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:31.543251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2e513fe2-322f-4401-8fb7-3548f6957495 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61a3ad310>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:31.597621 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2e513fe2-322f-4401-8fb7-3548f6957495 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/1807bbab-71e5-40be-a55f-afee4b2cc8ff" status: 200 len: 350 microversion: 2.1 time: 0.058955 Aug 23 08:17:31.599330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 46/95] 10.222.0.58 () {58 vars in 1245 bytes} [Tue Aug 23 08:17:31 2022] GET /compute/v2.1/os-volumes/1807bbab-71e5-40be-a55f-afee4b2cc8ff => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:17:31.601663 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:31.613784 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3ad19b45-8119-4a57-9f37-0f6b6dbbcbe3 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61a3800d0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:31.617619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4d238ec9-3d88-4e8f-81a4-44a24fde28a1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.229990 Aug 23 08:17:31.636766 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 50/96] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:31 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:31.736083 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3ad19b45-8119-4a57-9f37-0f6b6dbbcbe3 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.128514 Aug 23 08:17:31.737068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 47/97] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Aug 23 08:17:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:17:31.752250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a117c0d4-2d14-45fe-a1dc-00da39e280d8 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61ac37b80>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:31.768917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:31.770271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:31.778087 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:31.778726 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:31.779429 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:31.780350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:31.781028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:31.781656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:31.864335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a117c0d4-2d14-45fe-a1dc-00da39e280d8 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.114823 Aug 23 08:17:31.865499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 51/98] 10.222.0.58 () {58 vars in 1149 bytes} [Tue Aug 23 08:17:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:31.895308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c16d689e-2e5e-43cd-bfc1-a7802bd24281 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61b4c4670>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:31.971971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:31.982057 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1a7521b2-689c-407b-979e-052db3de5124 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.218092 Aug 23 08:17:31.984673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 48/99] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:31 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:32.007412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c16d689e-2e5e-43cd-bfc1-a7802bd24281 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.130984 Aug 23 08:17:32.008590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 52/100] 10.222.0.58 () {58 vars in 1134 bytes} [Tue Aug 23 08:17:31 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:32.016272 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:32.016712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:32.026383 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8e7bfcac-7edb-460c-97ef-96f65f159d0a tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61ac37b80>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:32.027437 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:32.027938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:32.028378 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:32.029117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:32.029594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:32.030017 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:32.202154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8e7bfcac-7edb-460c-97ef-96f65f159d0a tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.184080 Aug 23 08:17:32.203347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 53/101] 10.222.0.58 () {58 vars in 1167 bytes} [Tue Aug 23 08:17:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:32.217954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b3f28b29-8e96-4cf8-8319-02d842f9e9b9 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61a384820>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:32.280093 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:32.289333 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:32.295308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:32.296496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-09b91da0-bdb1-4fd3-ad26-fa57d2336408 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.284983 Aug 23 08:17:32.314152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 49/102] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:32 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:32.352083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b3f28b29-8e96-4cf8-8319-02d842f9e9b9 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.139557 Aug 23 08:17:32.353216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 54/103] 10.222.0.58 () {58 vars in 1170 bytes} [Tue Aug 23 08:17:32 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:32.367007 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0d651dbf-609b-4f5f-b915-8d29719141b7 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61a3ad3a0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:32.486821 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0d651dbf-609b-4f5f-b915-8d29719141b7 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.124541 Aug 23 08:17:32.487543 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 50/104] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Aug 23 08:17:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:32.502047 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-262fab1c-baad-41f1-85b4-1b270ff74742 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61ac2ea60>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:32.611642 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-262fab1c-baad-41f1-85b4-1b270ff74742 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.113905 Aug 23 08:17:32.613971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 55/105] 10.222.0.58 () {58 vars in 1188 bytes} [Tue Aug 23 08:17:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:32.627229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d1928eb1-0985-4916-9917-d2eb44d5e241 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] Calling method '.version_select at 0x7fa61a34c670>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:32.644830 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:32.645446 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:32.652863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:32.653350 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:32.653785 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:32.654535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:32.655059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:32.655498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:32.749938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d1928eb1-0985-4916-9917-d2eb44d5e241 tempest-VolumesTestJSON-1666825114 tempest-VolumesTestJSON-1666825114-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.126819 Aug 23 08:17:32.768790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 51/106] 10.222.0.58 () {58 vars in 1155 bytes} [Tue Aug 23 08:17:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:32.848232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:32.855963 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a242a3d4-fdd8-42bc-9f44-bff91f30fd3f tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.215703 Aug 23 08:17:32.856536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 56/107] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:32 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:33.014497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:33.015652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:33.023610 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:33.024519 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:33.025105 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:33.026388 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:33.027136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:33.027655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:33.163285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:33.177331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ac37c4cb-00d5-4bca-99b0-f283ec5bd710 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.161017 Aug 23 08:17:33.177331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 52/108] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:33 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:33.322425 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:33.323003 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:33.329075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:33.329550 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:33.329977 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:33.330654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:33.331139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:33.331558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:33.461345 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:33.470009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:33.471572 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:33.472685 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-88929d7e-ec60-4638-a544-72f0a7cc8863 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.154389 Aug 23 08:17:33.473239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 57/109] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:33 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:33.878363 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:33.880431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:33.886892 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:33.887569 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:33.890927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:33.890927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:33.890927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:33.890927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:34.062990 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:34.081323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f0eefeba-408e-4148-a7eb-6919198e0658 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.207404 Aug 23 08:17:34.087366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 53/110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:33 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:34.192114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:34.192756 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:34.199132 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:34.199680 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:34.200414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:34.207475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:34.207475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:34.207475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:34.336844 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:34.345583 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0cd9d7d2-48d4-4ee6-8d26-ec3d6ff9067b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.157539 Aug 23 08:17:34.346164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 58/111] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:34 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:34.495266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:34.495874 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:34.502312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:34.502803 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:34.503444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:34.504909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:34.505518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:34.506160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:34.643255 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:34.651453 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:34.652959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:34.654056 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b6e6d74e-2692-417e-bc9b-5018c80632e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.162822 Aug 23 08:17:34.654610 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 54/112] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:34 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:35.102362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:35.102919 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:35.109625 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:35.110114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:35.110547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:35.117636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:35.117636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:35.117636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:35.260963 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:35.270917 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3b18de31-5b19-4274-9538-f213fb7b15c5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.172932 Aug 23 08:17:35.283971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 59/113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:35 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:35.369634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:35.370337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:35.376502 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:35.376991 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:35.377432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:35.378133 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:35.378593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:35.379080 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:35.502432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:35.510795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-75fcc2a4-4d61-4acb-9bb5-ff210c1746f3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.145532 Aug 23 08:17:35.511386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 55/114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:35 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:17:35.676506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:35.677240 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:35.679116 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:35.683721 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:35.684199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:35.684634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:35.685316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:35.685764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:35.686186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:35.977194 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:35.985274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:35.986778 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:35.987939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b099111f-cf2d-4380-9ed4-102892607141 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.315917 Aug 23 08:17:35.989019 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 60/115] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:35 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:17:36.289713 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=8 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:36.293815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:36.294443 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:36.300344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:36.301339 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:36.301778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:36.302474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:36.302929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:36.303379 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:36.435627 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:36.444507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-73b852ba-7332-4079-a4d8-c8da1fdf4098 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.155453 Aug 23 08:17:36.445212 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 56/116] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:36 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:36.530720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:36.531367 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:36.537443 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:36.537925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:36.538361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:36.539087 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:36.539547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:36.539969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:36.668725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:36.676850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d03f08fe-448b-4741-bded-7d70e3daff99 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.150010 Aug 23 08:17:36.677411 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 61/117] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:36 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:37.010579 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:37.011180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:37.017566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:37.018050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:37.018486 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:37.019205 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:37.019664 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:37.020088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:37.145751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:37.153941 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:37.155663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:37.156633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0c712b76-64c3-4d15-8e9e-be062c68b80e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.150098 Aug 23 08:17:37.157220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 57/118] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:37 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:37.465521 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:37.466197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:37.472461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:37.472998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:37.473458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:37.474230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:37.474677 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:37.475187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:37.601466 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:37.609161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4415f11c-defd-4661-9dd2-e4d69df4262a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.147507 Aug 23 08:17:37.609729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 62/119] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:37 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:37.697517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:37.698129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:37.704346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:37.704823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:37.705263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:37.705939 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:37.706392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:37.706814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:37.852543 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:37.860744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7270275a-54f4-41b1-bd79-a508e9e9948e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.167032 Aug 23 08:17:37.861441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 58/120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:37 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:38.179734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:38.180493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:38.186462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:38.186961 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:38.187404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:38.188086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:38.188537 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:38.188955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:38.318631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:38.331861 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:38.333837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:38.335227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ac457479-b646-4d41-b006-7960724fc7a5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.159274 Aug 23 08:17:38.335903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 63/121] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:38 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:38.629856 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:38.630468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:38.636699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:38.637203 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:38.637667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:38.638365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:38.638843 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:38.639330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:38.772800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:38.780423 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b2f19b32-bd75-4186-a399-62021da25692 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.154459 Aug 23 08:17:38.780959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 59/122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:38 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:38.881615 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:38.883113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:38.896961 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:38.897662 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:38.898320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:38.899325 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:38.900030 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:38.900936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:39.279224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:39.286888 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a1e249c8-258b-4a51-ab4d-1bb965555557 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.409109 Aug 23 08:17:39.287948 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 64/123] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:38 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:39.357725 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:39.358354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:39.375547 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:39.376037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:39.376481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:39.377194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:39.377672 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:39.378096 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:39.529214 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-6d924850-e446-43d4-a449-0e9587662286 req-78169792-9879-4f70-908d-c50ffdd843d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895b9968-c8a0-4035-82f3-15a6726d65ed", "tag": "c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:39.538764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-6d924850-e446-43d4-a449-0e9587662286 req-78169792-9879-4f70-908d-c50ffdd843d4 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:39.539261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-6d924850-e446-43d4-a449-0e9587662286 req-78169792-9879-4f70-908d-c50ffdd843d4 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:39.539685 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-6d924850-e446-43d4-a449-0e9587662286 req-78169792-9879-4f70-908d-c50ffdd843d4 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:39.550592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-6d924850-e446-43d4-a449-0e9587662286 req-78169792-9879-4f70-908d-c50ffdd843d4 service nova] Creating event network-changed:c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097 for instance 895b9968-c8a0-4035-82f3-15a6726d65ed on hv-cinder-85407 Aug 23 08:17:39.555493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-6d924850-e446-43d4-a449-0e9587662286 req-78169792-9879-4f70-908d-c50ffdd843d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030313 Aug 23 08:17:39.556313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 65/124] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:39.556695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:39.565207 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:39.567262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:39.568408 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b0108598-dba9-42e2-b593-5d6a187e01e6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.214596 Aug 23 08:17:39.568965 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 60/125] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:39 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:39.802355 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:39.803083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:39.809549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:39.810030 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:39.810461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:39.811241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:39.811684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:39.812108 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:39.956147 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:39.964227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8bf8ea62-450b-4adb-9e90-c75477ed9646 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.166459 Aug 23 08:17:39.964829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 66/126] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:39 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:40.308026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:40.308614 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:40.314974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:40.315471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:40.315904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:40.316583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:40.317091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:40.317546 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:40.450177 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:40.458710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-380c89b5-41f6-4517-bd9a-2ea67eff5eeb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.155082 Aug 23 08:17:40.459346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 61/127] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:40 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:40.591944 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:40.592478 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:40.598989 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:40.599474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:40.599910 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:40.600592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:40.601051 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:40.601474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:40.725658 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:40.734137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:40.735727 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:40.736837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-156a7b57-1430-45a7-b021-b370b8747a2d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.148992 Aug 23 08:17:40.737388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 67/128] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:40 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:40.984573 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:40.985174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:40.991645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:40.992118 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:40.992544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:40.993218 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:40.993667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:40.994125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:41.135793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:41.143404 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-977cdfdf-9c86-40aa-ac13-0e7978a9fb4e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.162642 Aug 23 08:17:41.143967 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 62/129] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:40 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:41.479309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:41.479982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:41.486052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:41.486533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:41.486986 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:41.487740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:41.488255 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:41.489246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:41.616931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:41.624553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cc595807-6202-4ed2-97f6-468d1bad22e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.149307 Aug 23 08:17:41.625236 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 68/130] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:41 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:41.759438 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:41.760289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:41.766442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:41.766924 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:41.767382 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:41.768068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:41.768518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:41.768940 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:41.788428 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:41.902667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:41.911394 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:41.912914 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:41.914017 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a142f044-8366-41e9-82fb-9e164c931721 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.158743 Aug 23 08:17:41.914604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 63/131] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:41 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:17:42.164538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:42.165150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:42.171613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:42.172264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:42.172701 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:42.173409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:42.173826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:42.174241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:42.194547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:42.426300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:42.434568 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-580dcbfd-fde7-4651-86fa-0575a42e60ea tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.274750 Aug 23 08:17:42.435218 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 69/132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:42 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:42.645109 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:42.645719 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:42.655144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:42.655629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:42.656057 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:42.656750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:42.657197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:42.657642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:42.959382 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:42.961026 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:42.972282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:42.974238 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:42.974982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:42.975687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:42.976595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:42.977539 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:42.978166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:42.986693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-77501613-2654-4c5b-99c0-acd62001b698 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.342121 Aug 23 08:17:42.986693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 64/133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:42 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:43.240949 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:43.249614 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:43.251249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:43.252419 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1273b6da-ba8a-4d67-b2df-ffa38a249d97 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.314499 Aug 23 08:17:43.253147 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 70/134] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:42 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:43.580152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:43.580152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:43.580152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:43.580152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:43.582036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:43.582036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:43.582036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:43.582036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:43.640506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:43.653805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-220bdf10-b65b-4b8d-ba5c-bc4d1969c360 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.201304 Aug 23 08:17:43.654787 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 65/135] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:43 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:44.010387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:44.011117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:44.017110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:44.017588 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:44.018022 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:44.018699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:44.019283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:44.019707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:44.146946 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:44.154571 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-04b97d5a-5d63-41dd-9cee-f2aa92d1b1dc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.148885 Aug 23 08:17:44.155158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 71/136] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:44 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:44.275682 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:44.276598 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:44.282295 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:44.282779 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:44.283321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:44.284011 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:44.284468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:44.284888 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:44.414918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:44.422745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:44.424427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:44.425625 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-92d17abb-3664-4995-ae3a-6db04beff891 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.153755 Aug 23 08:17:44.426848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 66/137] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:44 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:44.675591 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:44.676605 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:44.683077 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:44.684239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:44.684239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:44.684653 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:44.685103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:44.685526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:44.862952 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:44.872482 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ff19192b-71ce-49f1-b978-ffbaa3dd30f8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.200864 Aug 23 08:17:44.884477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 72/138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:44 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:45.175812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:45.176537 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:45.182561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:45.183080 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:45.183521 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:45.184204 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:45.184661 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:45.185086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:45.314004 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:45.322814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-42d9e871-3b9b-47c7-a446-b40f5ebed5ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.151291 Aug 23 08:17:45.323575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 67/139] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:45 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:45.448962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:45.459373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:45.459373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:45.459373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:45.459373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:45.460305 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:45.460305 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:45.460305 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:45.595168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:45.606543 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:45.608158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:45.609709 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-70b523e9-cc19-40b4-80ec-b8f3b88714fa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.164957 Aug 23 08:17:45.610571 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 73/140] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:45 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:45.897356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:45.898119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:45.904489 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:45.905027 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:45.905466 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:45.906352 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:45.906807 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:45.907476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:46.046042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:46.052138 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-191992aa-5ec5-4db1-8fa4-f25a1d1f5d1e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.161698 Aug 23 08:17:46.054973 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 68/141] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:45 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:46.343684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:46.344303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:46.351005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:46.355686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:46.355686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:46.355686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:46.355686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:46.356079 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:46.484916 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:46.494340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-648fe31d-bed4-40a0-9c75-18d658c33c36 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.154702 Aug 23 08:17:46.494998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 74/142] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:46 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:46.632331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:46.634264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:46.640124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:46.640634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:46.641039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:46.641752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:46.642189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:46.642620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:46.780805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:46.791475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:46.793048 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:46.794329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ea6db2c4-1d6b-4991-9239-dc2b833fbb72 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.165981 Aug 23 08:17:46.794884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 69/143] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:46 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:47.073221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:47.073873 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:47.080201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:47.080810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:47.081251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:47.081977 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:47.082432 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:47.082856 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:47.218433 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:47.226605 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-db10db18-29fd-4ab9-ba97-cb4a3509f1ba tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.157267 Aug 23 08:17:47.227200 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 75/144] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:47 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:47.514768 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:47.515600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:47.522329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:47.524785 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:47.524785 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:47.524785 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:47.524785 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:47.525203 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:47.658981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:47.667126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ec38ebcb-14b4-441f-8f60-91792a5e2768 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.156121 Aug 23 08:17:47.667782 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 70/145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:47 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:47.818607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:47.819185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:47.825498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:47.825980 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:47.826410 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:47.827404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:47.827856 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:47.828270 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:47.960911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:47.968993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:47.970539 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:47.971662 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ec3780c7-c481-4fd7-a56d-a601a4b6b92a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.157714 Aug 23 08:17:47.972210 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 76/146] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:47 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:48.250513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:48.251181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:48.258097 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:48.258760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:48.259336 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:48.260220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:48.261067 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:48.261616 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:48.394573 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:48.403563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6a16fc76-fd8a-45ce-b0e6-c4c45ada19eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.157185 Aug 23 08:17:48.404193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 71/147] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:48 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:48.689581 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:48.694190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:48.696732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:48.697442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:48.697880 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:48.698577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:48.699205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:48.699812 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:48.833698 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:48.843566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-284a3def-e3ae-43ad-b294-5c372ef297cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.157899 Aug 23 08:17:48.844306 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 77/148] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:48 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:48.994274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:48.994930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:49.000917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:49.001400 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:49.001832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:49.002516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:49.003099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:49.003415 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:49.146587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:49.155138 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:49.156741 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:49.157950 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3c77bf8d-b184-4e79-9300-5c9df0d119d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.167602 Aug 23 08:17:49.158573 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 72/149] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:48 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:49.429263 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:49.430209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:49.438317 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:49.439301 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:49.440196 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:49.441551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:49.442380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:49.443128 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:49.586718 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:49.594594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4cd523ff-ab63-44df-aae9-e3c979e0fa05 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.172652 Aug 23 08:17:49.595182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 78/150] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:49 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:49.864766 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:49.865410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:49.871810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:49.872295 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:49.872737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:49.873427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:49.873881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:49.874307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:50.006934 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:50.015124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d0f15615-9791-45bc-9b55-b4f6d42af807 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.154141 Aug 23 08:17:50.028761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 73/151] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:49 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:50.181113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:50.181857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:50.188109 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:50.188828 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:50.189379 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:50.190295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:50.190840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:50.191401 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:50.323892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:50.332371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:50.334409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:50.335544 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ae681976-8467-49f3-844b-9fd839266a3b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.158743 Aug 23 08:17:50.336099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 79/152] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:50 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:50.493069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-a55d0140-79b5-4c8a-bb4f-bfeb2f740a05 req-88953149-fcb5-463a-9dff-8f26a335d04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb12ae3d-e305-4628-a89c-7a6f95c07fa8", "name": "network-vif-plugged", "status": "completed", "tag": "a1092aaf-fd40-4484-a5b6-c54eedb226c8"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:50.503047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-a55d0140-79b5-4c8a-bb4f-bfeb2f740a05 req-88953149-fcb5-463a-9dff-8f26a335d04c service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:50.503530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-a55d0140-79b5-4c8a-bb4f-bfeb2f740a05 req-88953149-fcb5-463a-9dff-8f26a335d04c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:50.503958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-a55d0140-79b5-4c8a-bb4f-bfeb2f740a05 req-88953149-fcb5-463a-9dff-8f26a335d04c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:50.517469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-a55d0140-79b5-4c8a-bb4f-bfeb2f740a05 req-88953149-fcb5-463a-9dff-8f26a335d04c service nova] Creating event network-vif-plugged:a1092aaf-fd40-4484-a5b6-c54eedb226c8 for instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 on hv-cinder-85407 Aug 23 08:17:50.524318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-a55d0140-79b5-4c8a-bb4f-bfeb2f740a05 req-88953149-fcb5-463a-9dff-8f26a335d04c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088713 Aug 23 08:17:50.524460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 74/153] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:50.616064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:50.616676 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:50.622749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:50.623265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:50.623700 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:50.624396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:50.624849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:50.625272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:50.782019 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:50.791728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d4cdc5c8-8a50-471f-89c0-2c451c4cb02c tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.179309 Aug 23 08:17:50.792373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 80/154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:50 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:51.039055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:51.043285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:51.045966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:51.046456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:51.046887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:51.047606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:51.048057 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:51.048484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:51.189299 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:51.198069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b85ae4c9-e592-4ac0-9fca-fcc325cc2bbd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.163487 Aug 23 08:17:51.207202 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 75/155] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:51 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:51.358689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:51.360606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:51.368358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:51.369177 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:51.369681 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:51.370501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:51.371025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:51.371490 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:51.542982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:51.551177 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:51.552678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:51.553773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4f4eb83c-cd35-44f1-9e05-a69d1aed3be7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.199039 Aug 23 08:17:51.554332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 81/156] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:51 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:51.813646 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:51.814289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:51.820315 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:51.820790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:51.821214 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:51.821889 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:51.822335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:51.822746 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:51.948809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:51.960512 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-add34e02-4441-46c6-a59d-90d4bb9647ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.150560 Aug 23 08:17:51.961092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 76/157] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:51 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:52.219760 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:52.220298 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:52.226061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:52.226536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:52.227002 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:52.227694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:52.228128 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:52.228546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:52.371489 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:52.379267 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6894f267-a6c3-4526-99bc-856349c6c348 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.163365 Aug 23 08:17:52.379831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 82/158] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:52 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:52.576641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:52.577319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:52.583645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:52.584179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:52.584611 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:52.586317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:52.586317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:52.586317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:52.726118 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:52.734845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:52.736420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:52.737712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-178dea1c-3fa2-4b53-a058-4b5426f58782 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.165292 Aug 23 08:17:52.738266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 77/159] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:52 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:52.981965 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:52.982739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:52.989454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:52.990135 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:52.990608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:52.991511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:52.992184 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:52.992865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:53.169588 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:53.177650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7da65529-49bb-4fcd-b626-a78a48913840 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.199565 Aug 23 08:17:53.179103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 83/160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:52 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:53.401233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:53.401849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:53.408200 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:53.408684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:53.409865 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:53.410603 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:53.411097 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:53.412074 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:53.550726 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:53.558372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-afc220c5-ce07-429c-9581-3e715ada9f20 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.161046 Aug 23 08:17:53.558955 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 78/161] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:53 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:53.760594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:53.765728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:53.767568 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:53.768054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:53.768569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:53.769182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:53.769625 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:53.770043 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:53.951189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:53.963243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:53.964969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:53.966153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-07fa8502-9f2a-42ac-b44d-f5c6bfc180cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.209852 Aug 23 08:17:53.966898 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 84/162] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:53 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:17:54.205044 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:54.207241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:54.226055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:54.227089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:54.227536 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:54.228239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:54.228844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:54.229376 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:54.362190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:54.371827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-67d2b1e6-70c7-45dd-ba68-0906bb6bf61a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.177449 Aug 23 08:17:54.372405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 79/163] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:54 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:54.583674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:54.584283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:54.590110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:54.590587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:54.591035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:54.591721 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:54.592177 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:54.592598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:54.725289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:54.732966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b55672a9-fd44-4afd-9a32-795ea8b6649b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.153075 Aug 23 08:17:54.733527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 85/164] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:54 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:54.988778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:54.989522 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:54.998585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:54.998585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:54.998585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:54.998585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:54.999009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:54.999009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:55.157153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:55.162266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:55.167528 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:55.169039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:55.170147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c5e576b9-8eaa-431d-bb9b-223ddf04b2da tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.185296 Aug 23 08:17:55.170801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 80/165] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:54 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:55.392899 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:55.393430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:55.399646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:55.400120 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:55.400543 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:55.401207 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:55.401648 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:55.402062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:55.405959 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:55.533535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:55.541600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0fe931cc-d5db-4413-b06c-ced6aa56cc53 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.152569 Aug 23 08:17:55.542294 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 86/166] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:55 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:55.753876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:55.754484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:55.760600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:55.761119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:55.761558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:55.762251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:55.762708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:55.763224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:55.899916 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:55.907517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4e3d6dd0-3875-41b5-ae24-ee7babd0bb58 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.157813 Aug 23 08:17:55.908260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 81/167] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:55 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:56.196430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:56.197240 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:56.204039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:56.204524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:56.204956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:56.205837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:56.206278 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:56.206782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:56.368762 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:56.386316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:56.390666 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:56.391882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f1a4c93a-99f8-4327-b7d3-178061f19c16 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.202199 Aug 23 08:17:56.403307 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 87/168] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:56 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:56.562761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:56.563422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:56.571599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:56.572066 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:56.572500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:56.573176 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:56.573629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:56.574050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:56.721516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:56.731656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bacca403-2fb5-4495-b3dc-933d426b694b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.172848 Aug 23 08:17:56.732236 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 82/169] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:56 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:56.933890 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:56.934500 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:56.940373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:56.940841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:56.941277 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:56.941956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:56.942409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:56.942832 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:57.072018 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:57.080068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-61e35961-4b70-4965-8555-35ebb7bacb27 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.150165 Aug 23 08:17:57.080625 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 88/170] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:56 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:57.416823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:57.417424 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:57.419254 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=83 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:17:57.423880 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:57.424355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:57.424792 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:57.425464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:57.425912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:57.426332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:57.555344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:57.563555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:57.565101 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:57.566196 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-248f29a8-9744-441c-92c2-086c3a9c99f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.153331 Aug 23 08:17:57.567003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 83/171] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:57 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:57.753589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:57.754211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:57.763168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:57.766788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:57.767636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:57.768567 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:57.769239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:57.771880 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:58.048322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:58.058268 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e874015c-f383-4c62-8bea-afc625d4d6a7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.308484 Aug 23 08:17:58.070553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 89/172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:57 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:58.076738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-60a6c598-7e14-455f-850f-450d38e74597 req-0dcbc657-19b1-451d-8ec9-3d18c0e85984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042d0cf1-0b41-42c7-8eb9-03e48f370ee5", "name": "network-vif-plugged", "status": "completed", "tag": "9f819a2e-e0a5-48e2-9a38-34bd2a1349c4"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:17:58.089270 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-60a6c598-7e14-455f-850f-450d38e74597 req-0dcbc657-19b1-451d-8ec9-3d18c0e85984 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:58.089901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-60a6c598-7e14-455f-850f-450d38e74597 req-0dcbc657-19b1-451d-8ec9-3d18c0e85984 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:58.091125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-60a6c598-7e14-455f-850f-450d38e74597 req-0dcbc657-19b1-451d-8ec9-3d18c0e85984 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:58.102244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:58.102974 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:58.107551 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-60a6c598-7e14-455f-850f-450d38e74597 req-0dcbc657-19b1-451d-8ec9-3d18c0e85984 service nova] Creating event network-vif-plugged:9f819a2e-e0a5-48e2-9a38-34bd2a1349c4 for instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 on hv-cinder-85407 Aug 23 08:17:58.111615 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:58.113463 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-60a6c598-7e14-455f-850f-450d38e74597 req-0dcbc657-19b1-451d-8ec9-3d18c0e85984 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040462 Aug 23 08:17:58.115908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 84/173] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:17:58.116015 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:58.116363 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:58.120542 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:58.121191 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:58.126384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:58.276699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:58.286015 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8a692da2-9b40-4990-b8a2-7b6e2c10c5c0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.189080 Aug 23 08:17:58.287306 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 90/174] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:58 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:58.592935 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:58.593549 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:58.600432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:58.600918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:58.601348 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:58.602070 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:58.602525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:58.602962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:58.731534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:58.740786 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:58.742304 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:58.743637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7d8a9b68-09a5-4499-a6a8-c198512e81a3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.155041 Aug 23 08:17:58.744229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 85/175] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:58 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:17:59.080381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:59.080995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:59.087428 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:59.087913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:59.088347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:59.089024 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:59.089476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:59.089938 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:59.227857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:59.235319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-450696f8-fe5e-4d4c-9af9-ab7dcf13e2d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.158955 Aug 23 08:17:59.235889 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 91/176] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:59 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:59.307299 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:59.307953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:59.314029 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:59.314513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:59.314962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:59.315659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:59.316483 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:59.316866 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:59.462265 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:59.470123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4319b6da-1bb3-4305-b521-3b660aea4d37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.167229 Aug 23 08:17:59.470703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 86/177] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:17:59 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:17:59.766463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:17:59.771423 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:17:59.775273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:59.775783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:59.776219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:59.777368 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:17:59.777822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:17:59.778401 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:17:59.941021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:59.950140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:59.951757 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:17:59.952865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-41d8af74-e309-4803-a59f-aeb077e3ee3a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.190725 Aug 23 08:17:59.953435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 92/178] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:17:59 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:18:00.154607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-7319b8c0-0a65-402d-93a4-b546ffab3f11 req-71cb0ca3-7157-4ed3-9576-d6b25dec3027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017c13ab-2fa1-46f8-bab7-1308c79c41b0", "name": "network-vif-plugged", "status": "completed", "tag": "edd2fddc-c817-4def-b863-9892d76cc2ad"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:18:00.168326 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-7319b8c0-0a65-402d-93a4-b546ffab3f11 req-71cb0ca3-7157-4ed3-9576-d6b25dec3027 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:00.169292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-7319b8c0-0a65-402d-93a4-b546ffab3f11 req-71cb0ca3-7157-4ed3-9576-d6b25dec3027 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:00.169994 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-7319b8c0-0a65-402d-93a4-b546ffab3f11 req-71cb0ca3-7157-4ed3-9576-d6b25dec3027 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:00.182632 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-7319b8c0-0a65-402d-93a4-b546ffab3f11 req-71cb0ca3-7157-4ed3-9576-d6b25dec3027 service nova] Creating event network-vif-plugged:edd2fddc-c817-4def-b863-9892d76cc2ad for instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 on hv-cinder-85407 Aug 23 08:18:00.201346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-7319b8c0-0a65-402d-93a4-b546ffab3f11 req-71cb0ca3-7157-4ed3-9576-d6b25dec3027 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050972 Aug 23 08:18:00.202094 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 87/179] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:18:00.257064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:00.258457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:00.264725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:00.265240 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:00.265841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:00.266722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:00.267373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:00.267790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:00.491922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:00.492629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:00.499831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:00.500329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:00.500770 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:00.501499 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:00.502739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:00.503623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:00.671231 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:00.680339 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2620281d-18f3-485f-835f-71a8ed4ab36a tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.427973 Aug 23 08:18:00.680912 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 93/180] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:00 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:00.695828 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:00.704170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-76d2c828-3987-4a10-a390-59328dd2cacf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.216928 Aug 23 08:18:00.704758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 88/181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:00 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:00.976971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:00.977645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:00.983947 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:00.984502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:00.984946 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:00.985642 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:00.986092 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:00.986594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:01.179024 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:01.187252 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:01.188780 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:01.189886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a31bf50d-f916-4775-8c55-7476773dfb71 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.217616 Aug 23 08:18:01.190492 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 94/182] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:00 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:18:01.701938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:01.702507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:01.708748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:01.709235 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:01.709670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:01.710348 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:01.710803 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:01.711266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:01.725052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:01.725714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:01.731514 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:01.732047 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:01.732476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:01.733149 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:01.733596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:01.734013 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:01.910568 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:01.917721 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:01.918916 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6d198298-ae88-45f2-ab9a-7a0895e692ac tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.220968 Aug 23 08:18:01.919513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 89/183] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:01 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:01.925294 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-83c94c7d-0595-466b-9246-c8fde9848343 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.204029 Aug 23 08:18:01.925842 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 95/184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:01 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:18:02.221662 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:02.222270 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:02.228962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:02.229580 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:02.230190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:02.231057 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:02.231978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:02.232403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:02.408438 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:02.420320 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:02.422198 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:02.424506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-850ad4f5-7121-4793-b2bf-581491aa91ba tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.213722 Aug 23 08:18:02.425962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 90/185] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:02 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:18:02.939752 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:02.940369 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:02.957068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:02.957068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:02.960731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:02.961227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:02.961659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:02.962387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:02.962869 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:02.963319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:02.966682 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:02.967224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:02.967652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:02.968360 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:02.968815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:02.969239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:03.172720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:03.173523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:03.183629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6e0617dd-5c85-4f74-a12b-f8fc6c07fc9b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.247717 Aug 23 08:18:03.184724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 96/186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:02 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:03.191424 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-717ce466-2b6a-40f7-ad3f-8b151cb22963 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.240288 Aug 23 08:18:03.192144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 91/187] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:02 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:03.446786 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:03.447417 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:03.453299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:03.453772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:03.454467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:03.455178 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:03.455628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:03.457948 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:03.594730 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:03.603316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:03.604821 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:03.605912 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6d778974-1156-4c9f-b127-54476fb68340 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.163438 Aug 23 08:18:03.606461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 97/188] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:03 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:18:04.207253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:04.210858 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:04.213829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:04.214542 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:04.225614 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:04.228357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:04.228848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:04.229024 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:04.229211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:04.229211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:04.229361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:04.229720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:04.230326 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:04.230506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:04.231076 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:04.231650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:04.452021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:04.461442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:04.461604 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7d638e3b-659d-4c40-9833-b6df3f166221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.252242 Aug 23 08:18:04.461897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 98/189] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:04 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:04.465287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7996a395-b31b-49e6-88e6-b9bc43c37845 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.263848 Aug 23 08:18:04.465893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 92/190] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:04 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:04.631885 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:04.632421 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:04.638316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:04.638816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:04.639317 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:04.639997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:04.640449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:04.640898 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:04.783509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:04.794472 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:04.796035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:04.797179 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b74c8966-5ab7-4699-b87c-afcde4461748 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.171478 Aug 23 08:18:04.797905 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 99/191] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:04 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:18:05.483047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:05.484246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:05.486712 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:05.487508 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:05.491915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:05.492614 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:05.493224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:05.494240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:05.494850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:05.495471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:05.495954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:05.496465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:05.496928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:05.497683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:05.498141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:05.498696 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:05.714139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:05.716904 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:05.723709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-74ea60b6-b914-4203-9698-f40de122349e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.245946 Aug 23 08:18:05.724569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b27a563b-01c0-4266-9e5e-45a05db68c68 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.242675 Aug 23 08:18:05.724696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 93/192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:05 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:05.735222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 100/193] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:05 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:05.819768 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:05.820376 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:05.826347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:05.826814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:05.827306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:05.827984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:05.828435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:05.828879 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:05.993444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:06.002092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:06.003641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:06.004771 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d476c2b3-4120-4351-aa0c-6bada7a8eb18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.188921 Aug 23 08:18:06.005329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 94/194] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:05 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:18:06.745655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:06.746267 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:06.748246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=82 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:06.749716 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:06.753494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:06.753698 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:06.753853 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:06.754245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:06.754957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:06.755406 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:06.755821 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:06.768288 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:06.768791 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:06.769232 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:06.769941 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:06.770653 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:06.771288 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:06.985303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:06.991077 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:07.005960 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7494bb20-0ac2-47fa-b759-26f48394a9f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.264304 Aug 23 08:18:07.006774 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 101/195] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:06 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:07.007011 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-15c49326-a546-45fd-a476-d65c7f01a2eb tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1314 microversion: 2.1 time: 0.263391 Aug 23 08:18:07.007756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 95/196] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:06 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:18:07.029581 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:07.030384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:07.037249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:07.038385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:07.038908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:07.040141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:07.040504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:07.041342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:07.095241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-98d45d2c-8daf-43f1-bb22-a64a314d2979 req-9ce99d0f-67a7-4a78-a2a9-2423f812d12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895b9968-c8a0-4035-82f3-15a6726d65ed", "name": "network-vif-plugged", "status": "completed", "tag": "c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:18:07.106158 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-98d45d2c-8daf-43f1-bb22-a64a314d2979 req-9ce99d0f-67a7-4a78-a2a9-2423f812d12c service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:07.106875 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-98d45d2c-8daf-43f1-bb22-a64a314d2979 req-9ce99d0f-67a7-4a78-a2a9-2423f812d12c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:07.107331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-98d45d2c-8daf-43f1-bb22-a64a314d2979 req-9ce99d0f-67a7-4a78-a2a9-2423f812d12c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:07.119451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-98d45d2c-8daf-43f1-bb22-a64a314d2979 req-9ce99d0f-67a7-4a78-a2a9-2423f812d12c service nova] Creating event network-vif-plugged:c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097 for instance 895b9968-c8a0-4035-82f3-15a6726d65ed on hv-cinder-85407 Aug 23 08:18:07.124877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-98d45d2c-8daf-43f1-bb22-a64a314d2979 req-9ce99d0f-67a7-4a78-a2a9-2423f812d12c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036839 Aug 23 08:18:07.125478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 96/197] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:18:07.193609 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:07.197772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:07.202761 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:07.204295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:07.205653 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1fbc965c-791d-432f-a220-c2364129884b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.181958 Aug 23 08:18:07.206210 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 102/198] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:07 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:18:08.029878 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:08.031209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:08.031891 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:08.033129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:08.039707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:08.039895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:08.040187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:08.040329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:08.040618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:08.040730 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:08.041307 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:08.041418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:08.041759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:08.041872 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:08.042174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:08.042309 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:08.258112 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:08.263555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:08.272105 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3b9c969d-07fd-410f-a28a-713aa9e8b2c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.246456 Aug 23 08:18:08.272786 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5c75a525-a846-49b6-9877-acb44f31c4f1 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1501 microversion: 2.1 time: 0.245097 Aug 23 08:18:08.286164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 103/199] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:08 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:08.287325 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 97/200] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:08 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1501 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:08.291298 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:08.292106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:08.298372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:08.298678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:08.299163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:08.299861 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:08.300319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:08.300745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:08.443199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:08.452884 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:08.454397 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:08.455937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ac24df9c-7929-43cf-8181-93fe1636da06 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.168602 Aug 23 08:18:08.456497 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 104/201] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:08 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:18:09.293770 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:09.294972 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:09.301051 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:09.301743 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:09.302214 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:09.303095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:09.304043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:09.304470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:09.454014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:09.462728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5c6dfb97-beab-4d1f-bbd9-d0217c3eb17a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1322 microversion: 2.1 time: 0.173327 Aug 23 08:18:09.463845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 98/202] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:09 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:09.480274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:09.482058 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:09.489953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:09.490789 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:09.491788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:09.492661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:09.493240 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:09.493766 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:09.672237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:09.681425 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:09.682967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:09.684111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b89b296f-9207-4551-8ee2-1476a2c3cdc9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.208728 Aug 23 08:18:09.684686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 105/203] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:09 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:18:10.485395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:10.486149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:10.494405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:10.494929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:10.495764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:10.496527 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:10.497446 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:10.498240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:10.527266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:10.665633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:10.673253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7d186b7f-75f5-495e-8e1a-f46a62a90d8e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1517 microversion: 2.1 time: 0.192185 Aug 23 08:18:10.673832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 99/204] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:10 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:10.695702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:18:10.697985 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:10.706376 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:10.707136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:10.707705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:10.707891 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:10.708357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:10.720432 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:10.720432 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:10.720432 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:10.721576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:10.721576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:10.721576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:10.721576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:10.721829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:10.721829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:10.839737 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lazy-loading 'flavor' on Instance uuid 017c13ab-2fa1-46f8-bab7-1308c79c41b0 {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:18:10.917797 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:10.930377 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:10.932125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:10.933308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c906d2cd-aaa2-4620-b397-d74c8f8079f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.229955 Aug 23 08:18:10.933867 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 100/205] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:10 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:18:11.258740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-dd730afe-9df7-4976-9c90-963a3a6580d0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0/action" status: 200 len: 32 microversion: 2.1 time: 0.568905 Aug 23 08:18:11.259414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 106/206] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:18:10 2022] POST /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0/action => generated 32 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 08:18:11.270511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:11.271229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:11.278562 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:11.279081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:11.279565 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:11.280302 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:11.280758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:11.281240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:11.468754 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:11.477162 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-44c2c1cf-4f75-415d-8bb9-869618a9e9fc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.211891 Aug 23 08:18:11.477765 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 101/207] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:11 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:11.577378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91cc0212-8dc1-48f4-a254-4666ca5c7a21"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:18:11.577378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:11.581480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:11.581964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:11.582401 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:11.583164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:11.586763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:11.586763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:11.957002 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:11.958454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:11.965536 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:11.966030 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:11.966468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:11.967192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:11.967656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:11.968081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:12.142098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:12.156121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:12.159497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:12.161182 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e0e02d76-0d7a-424e-81f7-f3dcfaf8deeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1407 microversion: 2.20 time: 0.209091 Aug 23 08:18:12.162274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 102/208] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:11 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:18:12.498805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:12.499708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:12.510490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:12.512520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:12.513145 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:12.517729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:12.517729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:12.517729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:12.645811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:12.654188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-445e15ec-eac6-473b-a081-e23a1ed53f0e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.160404 Aug 23 08:18:12.654748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 103/209] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:12 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:18:12.956596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d8140c3a-9820-4114-b31d-e436b49cff63 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "POST /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.389392 Aug 23 08:18:12.958017 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 107/210] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:18:11 2022] POST /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5/os-volume_attachments => generated 194 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:18:13.187810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:13.189523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:13.203241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:13.206535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:13.208144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:13.211523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:13.213964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:13.215206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:13.513700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:13.561668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:13.564478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:13.571944 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-32d96aac-83c7-4d4d-b3c8-a5f0eea857c7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1599 microversion: 2.20 time: 0.389868 Aug 23 08:18:13.572523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 104/211] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:18:13 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1599 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:18:13.603263 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:13.609211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:13.611777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:13.617690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:13.618114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:13.619295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:13.619740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:13.620155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:13.676442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:13.676960 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:13.685006 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:13.685586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:13.686124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:13.687078 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:13.687810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:13.688334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:13.798144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bd6acfd7-fd43-46b0-937f-b1a813a9d971 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.200546 Aug 23 08:18:13.799014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 108/212] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Aug 23 08:18:13 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-interface => generated 285 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:18:13.897847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:13.907122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a38f364c-47ee-45cf-84b6-f5ef2ab12968 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.235914 Aug 23 08:18:13.908277 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 105/213] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:13 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:18:14.928306 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:14.929618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:14.936362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:14.940316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:14.940316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:14.940316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:14.940316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:14.940754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:15.095618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:15.117895 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c6bbc9ec-e391-44f0-ae78-8295f9604e9d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.180367 Aug 23 08:18:15.118535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 109/214] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:14 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:15.333579 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-7097d93a-bfa4-4db4-b531-24788cc39e22 req-bf06421d-953e-4afe-8a2b-edf36c597c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895b9968-c8a0-4035-82f3-15a6726d65ed", "tag": "c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:18:15.345225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-7097d93a-bfa4-4db4-b531-24788cc39e22 req-bf06421d-953e-4afe-8a2b-edf36c597c04 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:15.345747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-7097d93a-bfa4-4db4-b531-24788cc39e22 req-bf06421d-953e-4afe-8a2b-edf36c597c04 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:15.346121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-7097d93a-bfa4-4db4-b531-24788cc39e22 req-bf06421d-953e-4afe-8a2b-edf36c597c04 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:15.370095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-7097d93a-bfa4-4db4-b531-24788cc39e22 req-bf06421d-953e-4afe-8a2b-edf36c597c04 service nova] Creating event network-changed:c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097 for instance 895b9968-c8a0-4035-82f3-15a6726d65ed on hv-cinder-85407 Aug 23 08:18:15.370095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-7097d93a-bfa4-4db4-b531-24788cc39e22 req-bf06421d-953e-4afe-8a2b-edf36c597c04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034962 Aug 23 08:18:15.370095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 106/215] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:18:16.125754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:16.126369 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:16.133041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:16.133525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:16.133957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:16.134652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:16.135144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:16.135569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:16.326434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:16.335025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-71298780-e337-4bdc-9eaf-1921e1e9b597 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.213022 Aug 23 08:18:16.347544 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 110/216] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:16 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:17.358524 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:17.359249 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:17.365478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:17.365964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:17.366403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:17.367159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:17.367616 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:17.368041 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:17.517150 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:17.526376 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e03b7ac9-e1ce-46e7-9a79-e473bd6c022f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.172226 Aug 23 08:18:17.527174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 107/217] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:17 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:18.548612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:18.549920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:18.560479 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:18.562182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:18.563069 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:18.563950 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:18.565392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:18.565392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:18.706335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:18.714084 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a13fa989-464b-4102-9945-f87cab34220d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.170099 Aug 23 08:18:18.714659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 111/218] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:18 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:19.735079 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:19.738232 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:19.741553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:19.742060 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:19.742496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:19.743193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:19.743641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:19.744056 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:19.876053 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:19.891592 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9edf30e2-8ad2-4244-ad75-2b799ce698ff tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.160280 Aug 23 08:18:19.892163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 108/219] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:19 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:20.912191 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:20.912885 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:20.920911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:20.921398 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:20.921834 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:20.922521 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:20.923029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:20.923477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:21.054203 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:21.061864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9fc76105-149c-44f4-9532-e039e6416657 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.153599 Aug 23 08:18:21.062471 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 112/220] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:20 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:22.082951 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:22.083480 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:22.089682 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:22.090168 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:22.090626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:22.091343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:22.091800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:22.092222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:22.218881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:22.227033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d527ebe1-bc10-4652-855c-cae1f7e1a026 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.147753 Aug 23 08:18:22.227591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 109/221] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:22 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:23.248251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:23.248864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:23.255437 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:23.255920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:23.256375 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:23.257048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:23.257501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:23.258502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:23.388330 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:23.395963 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-696bc245-162a-446c-a0b1-21f8a73989d3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.151502 Aug 23 08:18:23.398300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 113/222] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:23 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:24.417708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:24.418329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:24.424595 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:24.425082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:24.425523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:24.426208 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:24.426665 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:24.427135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:24.559831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:24.567666 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a7cfa019-044c-4e0d-8626-34821126a112 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.154918 Aug 23 08:18:24.568294 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 110/223] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:24 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:25.589095 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:25.589709 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:25.597898 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:25.598815 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:25.599074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:25.599795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:25.600245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:25.600664 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:25.765393 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:25.774450 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cb5cc047-aed4-431b-b1d2-e547d4c90e2f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.189112 Aug 23 08:18:25.775178 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 114/224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:25 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:26.795390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:26.795996 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:26.801812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:26.802297 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:26.802712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:26.803405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:26.803855 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:26.804268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:26.940405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:26.948730 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2f8ec9fa-7ad3-4a55-98a8-c4bba2946bae tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.157191 Aug 23 08:18:26.949296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 111/225] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:26 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:27.970875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:27.971585 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:27.978705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:27.979327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:27.979754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:27.980625 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:27.981218 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:27.981660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:28.176790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:28.189458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-84a90e89-2bb9-4267-badb-67d71bac4e3e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.222520 Aug 23 08:18:28.190698 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 115/226] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:27 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:28.292889 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:28.293425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:28.295408 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=58 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:28.300010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:28.300496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:28.300934 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:28.301659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:28.302117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:28.302541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:28.333608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:18:28.741775 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3dfd15c7-5d94-416b-8c96-d4a201fab12e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "DELETE /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 204 len: 0 microversion: 2.1 time: 0.452446 Aug 23 08:18:28.743431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 112/227] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:18:28 2022] DELETE /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:18:28.751632 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:28.752238 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:28.758854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:28.759448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:28.759997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:28.762914 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:28.762914 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:28.762914 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:28.783996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:28.906023 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:28.914168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-150f2e32-fee6-4dfe-b6f0-3f1aa91950d9 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.166288 Aug 23 08:18:28.915370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 116/228] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:28 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:29.212799 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:29.213477 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:29.219396 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:29.219813 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:29.220248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:29.220927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:29.221374 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:29.221787 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:29.369423 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:29.383953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-81bf0515-4475-4f2b-8595-01691a4c06ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.169560 Aug 23 08:18:29.383953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 113/229] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:29 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:29.936596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:29.939202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:29.944367 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:29.944936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:29.945289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:29.946076 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:29.946461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:29.946842 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:30.081682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:30.090628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5ec1f922-113b-4476-939f-d56843182afd tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.157871 Aug 23 08:18:30.091215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 117/230] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:29 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:30.402413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:30.403679 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:30.414396 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:30.418164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:30.418164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:30.418164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:30.418164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:30.419187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:30.557450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:30.565066 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f6c5e55d-b400-48dc-8367-f21f54382172 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.168213 Aug 23 08:18:30.578627 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 114/231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:30 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:31.112155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:31.112827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:31.120104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:31.120635 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:31.121064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:31.121759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:31.122204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:31.122618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:31.254439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:31.263053 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-37ee4a68-2e9e-42ab-8a3a-fd66dcd3fd10 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.154938 Aug 23 08:18:31.263617 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 118/232] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:31 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:31.585730 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:31.586355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:31.592176 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:31.592658 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:31.596513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:31.596513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:31.596513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:31.596513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:31.598650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:31.727155 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:31.732596 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2dd9d33f-6bf0-4837-98a3-0ad9f1c3f711 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.150827 Aug 23 08:18:31.733426 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 115/233] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:31 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:32.284431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:32.285249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:32.292758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:32.293244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:32.293677 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:32.294371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:32.294825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:32.295280 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:32.660360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:32.669957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-12f07e43-6813-4314-8461-49959fcd26c2 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.388592 Aug 23 08:18:32.670237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 119/234] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:32 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:32.754841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:32.755993 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:32.765684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:32.766251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:32.766771 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:32.767567 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:32.768088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:32.768599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:32.912634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:32.920688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-361efa0b-4dad-4773-a56b-4c415e4ce1f0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.170549 Aug 23 08:18:32.921251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 116/235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:32 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:33.689553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:33.690154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:33.696839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:33.697387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:33.697834 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:33.698569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:33.699091 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:33.699516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:33.836287 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:33.845241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-640308fa-b97f-46dd-94f6-926f068f4e51 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.159507 Aug 23 08:18:33.846056 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 120/236] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:33 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:33.942890 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:33.943416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:33.951046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:33.951781 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:33.952709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:33.953758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:33.954414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:33.955094 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:34.152242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:34.169945 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5c3de5a5-74bc-4a2a-ae88-42ffb7c5bdfe tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.222786 Aug 23 08:18:34.169945 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 117/237] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:33 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:34.869141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:34.869742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:34.875971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:34.876446 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:34.876874 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:34.879312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:34.879312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:34.879312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:35.006785 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:35.015099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7a305fe5-ccfc-4c0c-a60c-c0bd138ec160 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.149977 Aug 23 08:18:35.015664 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 121/238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:34 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:35.181412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:35.182021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:35.188524 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:35.189010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:35.189447 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:35.190179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:35.190642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:35.191096 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:35.338915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:35.346754 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a93485b2-4c08-47da-8315-aee0332b3edd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.169266 Aug 23 08:18:35.347359 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 118/239] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:35 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:36.035381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:36.035916 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:36.044018 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:36.044502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:36.044941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:36.045676 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:36.046131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:36.046560 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:36.179936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:36.188160 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-faec3677-2e9a-4b6f-966e-98a79a493c41 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.156757 Aug 23 08:18:36.188728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 122/240] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:36 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:36.368469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:36.369184 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:36.376505 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:36.377066 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:36.377621 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:36.378351 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:36.378805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:36.379284 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:36.509422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:36.517492 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-103b7d1f-263b-462d-8de0-96bbbb0b71da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.153718 Aug 23 08:18:36.518091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 119/241] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:36 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:18:37.209849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:37.210795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:37.213335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=44 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:37.218268 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:37.218777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:37.219203 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:37.219890 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:37.220345 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:37.220766 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:37.351114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:37.359370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bdaaba9d-c8f9-4d46-b900-53117e5b87e3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.153602 Aug 23 08:18:37.359952 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 123/242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:37 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:37.538306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:37.538917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:37.544873 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:37.545359 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:37.545795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:37.546479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:37.546949 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:37.547385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:37.675831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:37.684098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ee8b2d97-3ed1-4e79-9e57-30f87cc747c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.149638 Aug 23 08:18:37.684661 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 120/243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:37 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:38.379957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:38.380631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:38.387091 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:38.387568 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:38.387998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:38.388676 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:38.389122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:38.389540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:38.520903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:38.529672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-70e24588-f411-483a-bd51-fc5cf73815d7 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.153648 Aug 23 08:18:38.530230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 124/244] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:38 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:38.705437 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:38.706147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:38.713147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:38.713636 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:38.714096 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:38.714790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:38.715274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:38.715696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:38.842072 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:38.849750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-915a4e8a-0c0e-4a99-964f-2cd006ee8708 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.148138 Aug 23 08:18:38.850310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 121/245] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:38 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:39.550996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:39.551601 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:39.558800 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:39.559309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:39.559808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:39.560403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:39.560849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:39.561268 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:39.688663 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:39.696801 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-74a3ccb7-a724-4088-854d-0c0aae844ff8 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.149757 Aug 23 08:18:39.697365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 125/246] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:39 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:18:39.870640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:39.871271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:39.877389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:39.877864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:39.878353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:39.879057 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:39.879511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:39.879925 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:40.006748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:40.015230 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9129a3da-2722-46df-afd9-048559acb250 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.148394 Aug 23 08:18:40.015789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 122/247] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:39 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:40.720098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:40.721212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:40.731895 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:40.733169 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:40.733764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:40.734466 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:40.735367 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:40.736025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:40.885613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:40.893898 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-20dcec65-080d-492e-ab6b-6fc6df7507b6 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1553 microversion: 2.1 time: 0.178749 Aug 23 08:18:40.894710 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 126/248] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:40 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1553 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:41.035967 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:41.036684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:41.042758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:41.043263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:41.043702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:41.044385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:41.044837 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:41.045417 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:41.190475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:41.198544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6f6a13a7-a1f8-4abe-8f6a-e5cd8544960e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.166463 Aug 23 08:18:41.199137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 123/249] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:41 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:41.346692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-782aacc4-06db-4dce-afa5-b17cc0e2d16b req-7aa3c5c0-ea8e-42c5-9512-68bb3f423a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042d0cf1-0b41-42c7-8eb9-03e48f370ee5", "name": "network-vif-deleted", "tag": "9f819a2e-e0a5-48e2-9a38-34bd2a1349c4"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:18:41.362247 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-782aacc4-06db-4dce-afa5-b17cc0e2d16b req-7aa3c5c0-ea8e-42c5-9512-68bb3f423a6d service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:41.362839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-782aacc4-06db-4dce-afa5-b17cc0e2d16b req-7aa3c5c0-ea8e-42c5-9512-68bb3f423a6d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:41.363608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-782aacc4-06db-4dce-afa5-b17cc0e2d16b req-7aa3c5c0-ea8e-42c5-9512-68bb3f423a6d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:41.377221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-782aacc4-06db-4dce-afa5-b17cc0e2d16b req-7aa3c5c0-ea8e-42c5-9512-68bb3f423a6d service nova] Creating event network-vif-deleted:9f819a2e-e0a5-48e2-9a38-34bd2a1349c4 for instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 on hv-cinder-85407 Aug 23 08:18:41.382612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-782aacc4-06db-4dce-afa5-b17cc0e2d16b req-7aa3c5c0-ea8e-42c5-9512-68bb3f423a6d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043451 Aug 23 08:18:41.383328 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 127/250] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:18:41.915912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:41.916541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:41.922733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:41.923261 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:41.923699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:41.924382 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:41.924923 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:41.925330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:41.993561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:42.011100 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b89de06f-d566-406b-a58a-ee1ffd7cc39b tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1345 microversion: 2.1 time: 0.098536 Aug 23 08:18:42.012496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 124/251] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:41 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:42.220851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:42.221519 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:42.228772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:42.229279 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:42.229724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:42.230371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:42.230817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:42.231254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:42.381811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:42.392695 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a8bf1fa8-6999-4c49-b819-914f3a51a84f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.176775 Aug 23 08:18:42.393865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 128/252] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:42 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:43.038381 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:43.039021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:43.045750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:43.046240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:43.046688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:43.047476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:43.047938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:43.048391 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:43.080317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:43.080798 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:43.081233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:43.081688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lazy-loading 'fault' on Instance uuid 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:18:43.179292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd81f4241d7343e990aea15e49be5f81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d310b6c64154e3bb5d95f1e762e3e80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:43.188612 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f062540a-2c31-403a-adbb-ad31c0da79f3 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 200 len: 1304 microversion: 2.1 time: 0.155503 Aug 23 08:18:43.190193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 125/253] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:43 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 1304 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:43.425338 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:43.425338 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:43.427750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:43.428320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:43.428892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:43.429704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:43.430482 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:43.432201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:43.591511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:43.599302 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3b27e180-2eaa-4169-87a1-c47b2086715f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.189624 Aug 23 08:18:43.599874 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 129/254] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:43 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:44.209842 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:44.210744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:44.218132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:44.218413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:44.218840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:44.219555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:44.220004 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:44.220471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:44.235369 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] HTTP exception thrown: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Request method failure captured: Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 HTTP/1.1 Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0EIpcjQaMIUl8gYx-FS_U18R6WIgh2jcOlg2BsgqTuOaZcVVvc86NYzWKbujCGvuM2H4ePv7cpZ1CCxrmm1g_InrRi_Fv-zm_fWB0Y9grnmAp01HIxeKqKiZxdV9N_E1B95ovcGe99gD6oPB9kOeUflHnCEGFggHQG3-llrT8wXx8 Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 7d310b6c64154e3bb5d95f1e762e3e80 Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:18:44.240366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d310b6c64154e3bb5d95f1e762e3e80", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 7d310b6c64154e3bb5d95f1e762e3e80 Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-DeleteServersTestJSON-499925540-project Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: dd81f4241d7343e990aea15e49be5f81 Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-DeleteServersTestJSON-499925540-project Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.244550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '042d0cf1-0b41-42c7-8eb9-03e48f370ee5'} Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:18:44.245440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.246790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.248468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Returning 404 to user: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:18:44.248468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5c87a0cc-ab98-4d7e-9e29-530cd215f0f5 tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 404 len: 111 microversion: 2.1 time: 0.036036 Aug 23 08:18:44.248468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 126/255] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:44 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:18:44.363804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:44.363804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:44.370256 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:44.370751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:44.371341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:44.372039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:44.372496 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:44.372918 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:44.386595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] HTTP exception thrown: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Request method failure captured: Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5/os-volume_attachments HTTP/1.1 Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI0EIpcjQaMIUl8gYx-FS_U18R6WIgh2jcOlg2BsgqTuOaZcVVvc86NYzWKbujCGvuM2H4ePv7cpZ1CCxrmm1g_InrRi_Fv-zm_fWB0Y9grnmAp01HIxeKqKiZxdV9N_E1B95ovcGe99gD6oPB9kOeUflHnCEGFggHQG3-llrT8wXx8 Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 7d310b6c64154e3bb5d95f1e762e3e80 Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:18:44.390736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d310b6c64154e3bb5d95f1e762e3e80", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 7d310b6c64154e3bb5d95f1e762e3e80 Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-DeleteServersTestJSON-499925540-project Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: dd81f4241d7343e990aea15e49be5f81 Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-DeleteServersTestJSON-499925540-project Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.400402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'server_id': '042d0cf1-0b41-42c7-8eb9-03e48f370ee5'} Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:18:44.401380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:44.402849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:44.404534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Returning 404 to user: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:18:44.404534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d8599527-6c7f-4718-91b6-4fd2493298ff tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035440 Aug 23 08:18:44.404534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 130/256] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:18:44 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:18:44.621117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:44.621731 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:44.627896 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:44.628456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:44.628827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:44.629541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:44.630197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:44.630624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:44.836724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:44.844946 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0013a1cd-8e9b-417f-859f-27f267708eaf tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.228359 Aug 23 08:18:44.858978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 127/257] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:44 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:45.867703 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:45.868316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:45.875824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:45.876310 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:45.876747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:45.877444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:45.877896 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:45.878319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:46.049522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:46.058854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a2dbd912-7914-4b51-a5bd-113dae7c7492 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.195053 Aug 23 08:18:46.059853 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 131/258] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:45 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:47.082617 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:47.083871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:47.096645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:47.097152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:47.097599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:47.098315 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:47.098750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:47.099673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:47.262576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:47.270727 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8669bd38-e16f-430d-b014-76bcbbbabd28 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.194474 Aug 23 08:18:47.271643 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 128/259] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:47 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:48.291582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:48.292222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:48.298580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:48.299254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:48.299605 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:48.300296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:48.300747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:48.301168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:48.430271 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:48.439045 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-089b0eb2-4c06-4f83-9829-2002f93031f1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.151262 Aug 23 08:18:48.442576 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 132/260] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:48 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:49.464920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:49.465617 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:49.472234 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:49.473155 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:49.473155 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:49.474114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:49.474785 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:49.475392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:49.619795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:49.627644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-811edd1d-d20d-49db-b946-b9876c11fc35 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.169408 Aug 23 08:18:49.628219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 129/261] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:49 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:50.648636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:50.649245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:50.655630 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:50.656110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:50.656540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:50.657224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:50.658204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:50.658622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:50.788691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:50.796797 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a211922f-89a4-495b-b202-a4540043fd63 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.151998 Aug 23 08:18:50.797355 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 133/262] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:50 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:51.415156 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:51.415643 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:51.421597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:51.422077 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:51.422508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:51.423211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:51.423656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:51.424068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:51.437500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] HTTP exception thrown: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Request method failure captured: Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 HTTP/1.1 Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0EIpcjQaMIUl8gYx-FS_U18R6WIgh2jcOlg2BsgqTuOaZcVVvc86NYzWKbujCGvuM2H4ePv7cpZ1CCxrmm1g_InrRi_Fv-zm_fWB0Y9grnmAp01HIxeKqKiZxdV9N_E1B95ovcGe99gD6oPB9kOeUflHnCEGFggHQG3-llrT8wXx8 Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 7d310b6c64154e3bb5d95f1e762e3e80 Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:18:51.439471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d310b6c64154e3bb5d95f1e762e3e80", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 7d310b6c64154e3bb5d95f1e762e3e80 Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-DeleteServersTestJSON-499925540-project Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: dd81f4241d7343e990aea15e49be5f81 Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-DeleteServersTestJSON-499925540-project Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.441042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '042d0cf1-0b41-42c7-8eb9-03e48f370ee5'} Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:18:51.442000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.443224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.444447 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Returning 404 to user: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:18:51.444447 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-57a63686-5928-4d32-ba09-ac4bd105744e tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "DELETE /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 404 len: 111 microversion: 2.1 time: 0.030101 Aug 23 08:18:51.444447 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 130/263] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:18:51 2022] DELETE /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:18:51.449646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:51.450246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] [instance: 042d0cf1-0b41-42c7-8eb9-03e48f370ee5] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:51.456185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:51.456655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:51.457086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:51.457760 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:51.458204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:51.458618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:51.474725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] HTTP exception thrown: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Request method failure captured: Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 HTTP/1.1 Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI0EIpcjQaMIUl8gYx-FS_U18R6WIgh2jcOlg2BsgqTuOaZcVVvc86NYzWKbujCGvuM2H4ePv7cpZ1CCxrmm1g_InrRi_Fv-zm_fWB0Y9grnmAp01HIxeKqKiZxdV9N_E1B95ovcGe99gD6oPB9kOeUflHnCEGFggHQG3-llrT8wXx8 Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 7d310b6c64154e3bb5d95f1e762e3e80 Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:18:51.476837 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d310b6c64154e3bb5d95f1e762e3e80", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d310b6c64154e3bb5d95f1e762e3e80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 7d310b6c64154e3bb5d95f1e762e3e80 Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-DeleteServersTestJSON-499925540 Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-DeleteServersTestJSON-499925540-project Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: dd81f4241d7343e990aea15e49be5f81 Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-DeleteServersTestJSON-499925540-project Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.478322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '042d0cf1-0b41-42c7-8eb9-03e48f370ee5'} Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:18:51.479545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. Aug 23 08:18:51.480673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:18:51.481827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] Returning 404 to user: Instance 042d0cf1-0b41-42c7-8eb9-03e48f370ee5 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:18:51.481827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-11be9bcf-d60a-4fd2-b6d7-4ea5cc7fa6ae tempest-DeleteServersTestJSON-499925540 tempest-DeleteServersTestJSON-499925540-project] 10.222.0.58 "GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5" status: 404 len: 111 microversion: 2.1 time: 0.032845 Aug 23 08:18:51.481827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 134/264] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:51 2022] GET /compute/v2.1/servers/042d0cf1-0b41-42c7-8eb9-03e48f370ee5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 08:18:51.817560 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:51.818085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:51.824528 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:51.825016 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:51.825451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:51.826145 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:51.826595 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:51.827044 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:51.977197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:51.985262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a3e49d84-28d3-4ebe-be11-b1551b1be137 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.171496 Aug 23 08:18:51.985861 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 131/265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:51 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:53.007057 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:53.007680 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:53.015171 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:53.015668 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:53.016094 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:53.016777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:53.017220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:53.017633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:53.021847 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:53.150955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:53.158659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-39291d28-ee8a-43fd-988f-4b803eb586ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.155765 Aug 23 08:18:53.159260 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 135/266] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:53 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:54.180139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:54.180695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:54.186783 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:54.187313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:54.187751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:54.188439 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:54.188897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:54.189342 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:54.321037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:54.324669 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:18:54.329478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5db68893-e915-4f43-820f-02a578fd1700 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.153366 Aug 23 08:18:54.330070 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 132/267] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:54 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:55.351758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:55.352770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:55.358775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:55.359296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:55.359738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:55.360479 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:55.360940 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:55.361360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:55.495841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:55.503524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7d8524d9-8c2b-4afd-bc14-9c951cf020db tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.156132 Aug 23 08:18:55.504085 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 136/268] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:55 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:56.525149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:56.526280 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:56.532382 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:56.532868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:56.533306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:56.533998 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:56.534459 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:56.534882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:56.671740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:56.679909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2f2d9219-56e0-447f-a736-ae1062f33523 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.159043 Aug 23 08:18:56.680477 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 133/269] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:56 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:57.704534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:57.704534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:57.710506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:57.711633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:57.712248 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:57.712952 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:57.714154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:57.714752 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:57.868501 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2015663172", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "networks": [{"uuid": "849e7e7d-9d32-4358-9c29-338e787c96fa"}]}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:18:57.874571 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:57.886797 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7db91520-8fe3-4e11-81e5-ec2a46d82afd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.188708 Aug 23 08:18:57.887398 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 137/270] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:57 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:57.939389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] validate_networks() for [('849e7e7d-9d32-4358-9c29-338e787c96fa', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:18:58.299141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:18:58.299561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:18:58.300027 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:18:58.300428 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:18:58.301300 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:18:58.312083 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:58.312659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:58.313268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:58.313993 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:58.314473 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:58.315091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:58.331823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Getting quotas for project cdbd04906d2b42fba52e61f3dbd0af21. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:18:58.335806 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Getting quotas for user 45777028be184247b0a58eee7d2c7e45 and project cdbd04906d2b42fba52e61f3dbd0af21. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:18:58.347337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:18:58.349646 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:18:58.598165 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-55ec776f-0656-4d98-ad36-6c7a32065d11 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733505 Aug 23 08:18:58.598803 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 134/271] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:18:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 08:18:58.610006 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f6a202ee-3aa1-4640-bdde-8bc4bed8ef4b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:58.610612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f6a202ee-3aa1-4640-bdde-8bc4bed8ef4b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:58.663462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f6a202ee-3aa1-4640-bdde-8bc4bed8ef4b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:58.670964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f6a202ee-3aa1-4640-bdde-8bc4bed8ef4b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1214 microversion: 2.1 time: 0.064692 Aug 23 08:18:58.671519 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 138/272] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:58 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:58.911573 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:58.912180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:58.918193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:58.918677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:58.919141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:58.919822 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:18:58.920274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:18:58.920695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:18:59.050377 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:59.058055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ba2886ef-977d-40c9-a9be-82ca9c253221 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.150316 Aug 23 08:18:59.058622 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 135/273] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:58 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:18:59.691458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c5004aba-e6e7-4f54-9771-229585acd071 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:18:59.692156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c5004aba-e6e7-4f54-9771-229585acd071 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:18:59.747261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c5004aba-e6e7-4f54-9771-229585acd071 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:18:59.756896 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c5004aba-e6e7-4f54-9771-229585acd071 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1214 microversion: 2.1 time: 0.069236 Aug 23 08:18:59.757595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 139/274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:18:59 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:00.079474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:00.080076 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:00.081929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:00.086796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:00.087330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:00.087762 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:00.088439 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:00.089379 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:00.089844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:00.223793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:00.231609 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8d34393c-40e5-45b1-b179-b927666bb194 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.155921 Aug 23 08:19:00.232176 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 136/275] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:00 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:00.777600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:00.778209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:00.784808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:00.785300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:00.785741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:00.786434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:00.786890 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:00.787335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:00.846895 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:00.854363 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b099b108-e224-4bd0-99e6-4c4cc163385d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1218 microversion: 2.1 time: 0.080670 Aug 23 08:19:00.854931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 140/276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:00 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:01.252395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:01.253026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:01.258812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:01.259381 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:01.259878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:01.260563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:01.261514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:01.261929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:01.393891 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:01.401778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9c64b4dc-ba4b-44a2-85ee-0a0ac1476eed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.153461 Aug 23 08:19:01.402347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 137/277] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:01 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:01.874882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:01.879085 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:01.881953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:01.882468 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:01.882903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:01.883601 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:01.884048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:01.884462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:01.945134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:01.953221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-247a934e-f2fa-4e24-8125-01cb863163bf tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1210 microversion: 2.1 time: 0.082110 Aug 23 08:19:01.953828 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 141/278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:01 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:02.422043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:02.422725 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:02.428785 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:02.429271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:02.429703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:02.430384 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:02.430832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:02.431282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:02.562876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:02.570567 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-28389399-9c3c-4112-88e0-2b978a5df73f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.152474 Aug 23 08:19:02.571086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 138/279] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:02 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:02.979178 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:02.979844 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:02.986088 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:02.986569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:02.987025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:02.987734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:02.988190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:02.988598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:03.052082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:03.060437 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2168c143-e00b-42f3-87ad-4978a1f82dff tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1266 microversion: 2.1 time: 0.085085 Aug 23 08:19:03.061274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 142/280] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:02 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:03.593199 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:03.593964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:03.603794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:03.604293 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:03.605271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:03.605965 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:03.606631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:03.607035 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:03.765146 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:03.772921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9c1e603b-8d84-484d-943d-79683a056d22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.184058 Aug 23 08:19:03.773489 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 139/281] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:03 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:04.089340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:04.089868 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:04.096205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:04.096683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:04.097109 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:04.097790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:04.098232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:04.098648 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:04.160619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:04.168840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5290025b-4308-4472-9dfe-13d5e3769d59 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1266 microversion: 2.1 time: 0.083716 Aug 23 08:19:04.169401 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 143/282] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:04 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:04.794779 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:04.795421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:04.801437 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:04.801923 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:04.802394 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:04.803106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:04.803561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:04.803986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:04.936284 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:04.944514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f197602e-1a9c-4c29-81e8-65526eaf2034 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.154190 Aug 23 08:19:04.945088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 140/283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:04 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:05.189812 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:05.190555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:05.197010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:05.197499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:05.197937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:05.199146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:05.199605 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:05.200053 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:05.261939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:05.269406 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7992917c-247d-480e-96b0-460a0c8ec5b2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1266 microversion: 2.1 time: 0.083580 Aug 23 08:19:05.269958 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 144/284] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:05 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:05.967336 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:05.967878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:05.973740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:05.974230 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:05.974668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:05.975390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:05.975852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:05.976280 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:06.102532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:06.110406 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f90128e2-94ab-47d5-8a3f-98512e849661 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.147672 Aug 23 08:19:06.111065 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 141/285] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:05 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:06.290195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:06.300232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:06.300232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:06.300232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:06.300232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:06.300559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:06.300559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:06.300559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:06.362022 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:06.370690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1200ced3-2cfb-4c24-8151-a648d98f5392 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1266 microversion: 2.1 time: 0.084288 Aug 23 08:19:06.371886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 145/286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:06 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:07.131826 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:07.132436 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:07.138465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:07.138964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:07.139423 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:07.140159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:07.140660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:07.141090 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:07.276514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:07.285030 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f7b796f0-aff3-436f-896e-24e9d73b2bbc tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1523 microversion: 2.1 time: 0.157267 Aug 23 08:19:07.285604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 142/287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:07 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:07.392993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:07.393606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:07.395891 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=50 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:07.400549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:07.400980 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:07.401435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:07.402148 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:07.402580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:07.403529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:07.465129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:07.473378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-75629cd2-cb68-4d10-bff4-62757c323541 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1266 microversion: 2.1 time: 0.084630 Aug 23 08:19:07.473965 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 146/288] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:07 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:08.313988 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:08.315710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:08.322316 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:08.323326 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:08.323965 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:08.324958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:08.325958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:08.326542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:08.327156 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:08.344131 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=6 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:08.498782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:08.503272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:08.522067 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:08.522757 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:08.524464 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:08.531405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:08.531405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:08.531405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:08.565115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:08.573507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7c636df4-7f42-4cae-90cb-554720f6d324 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1503 microversion: 2.1 time: 0.268878 Aug 23 08:19:08.574111 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 143/289] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:08 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1503 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:08.599224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:08.600289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:08.607575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:08.615115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:08.615115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:08.615115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:08.615115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:08.615558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:08.615639 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:08.624104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-371acf48-3f99-4332-b01a-6f49690f3126 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1284 microversion: 2.1 time: 0.133191 Aug 23 08:19:08.625074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 147/290] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:08 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:08.813098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:08.825911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ff04f057-6d8a-4c6f-8038-ab21de2d39f8 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1516 microversion: 2.1 time: 0.233666 Aug 23 08:19:08.830361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 144/291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:08 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:09.645990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:09.646630 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:09.653601 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:09.654114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:09.654612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:09.655354 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:09.655807 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:09.656233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:09.755488 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=4 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:09.840879 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:09.846065 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f7b0496d-e656-4dee-a758-d920abd5fe33 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.204130 Aug 23 08:19:09.847619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 148/292] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:09 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:10.347077 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-c17c27fc-0a20-47eb-af11-d43ab09fee03 req-2c83a2a5-672a-487b-b0c0-bf37b8e5a9bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83e8dd2e-8677-468c-8c3a-fa7da1e0df0b", "tag": "b272b030-dc27-4475-b1cf-619ab9236556"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:10.359549 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-c17c27fc-0a20-47eb-af11-d43ab09fee03 req-2c83a2a5-672a-487b-b0c0-bf37b8e5a9bb service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:10.360347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-c17c27fc-0a20-47eb-af11-d43ab09fee03 req-2c83a2a5-672a-487b-b0c0-bf37b8e5a9bb service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:10.360932 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-c17c27fc-0a20-47eb-af11-d43ab09fee03 req-2c83a2a5-672a-487b-b0c0-bf37b8e5a9bb service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:10.373491 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-c17c27fc-0a20-47eb-af11-d43ab09fee03 req-2c83a2a5-672a-487b-b0c0-bf37b8e5a9bb service nova] Creating event network-changed:b272b030-dc27-4475-b1cf-619ab9236556 for instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b on hv-cinder-85407 Aug 23 08:19:10.378820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-c17c27fc-0a20-47eb-af11-d43ab09fee03 req-2c83a2a5-672a-487b-b0c0-bf37b8e5a9bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035413 Aug 23 08:19:10.379832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 145/293] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:19:10.869395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:10.870010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:10.876429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:10.876970 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:10.877400 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:10.878088 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:10.878575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:10.879017 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:11.039683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:11.051600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8015056b-97b3-4a0e-a329-8f0ecc55be23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.186243 Aug 23 08:19:11.059080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 149/294] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:10 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:12.060415 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:12.063306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:12.070175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:12.070654 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:12.075892 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:12.075892 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:12.075892 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:12.075892 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:12.077359 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:12.078020 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:12.085060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:12.085630 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:12.086145 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:12.087201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:12.087721 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:12.088274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:12.098054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lazy-loading 'flavor' on Instance uuid bb12ae3d-e305-4628-a89c-7a6f95c07fa8 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:19:12.235905 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:12.243526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-31490f68-dcc9-4a1f-a442-d4ae5cd57d69 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.170360 Aug 23 08:19:12.244087 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 150/295] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:12 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:12.509070 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e5f11be5-de58-4f88-b31a-9e31593a77e5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8/action" status: 200 len: 32 microversion: 2.1 time: 0.456641 Aug 23 08:19:12.509698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 146/296] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:19:12 2022] POST /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8/action => generated 32 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:19:12.519255 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:12.519869 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:12.525747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:12.526258 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:12.526689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:12.527397 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:12.527853 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:12.528278 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:12.671552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:12.679204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-07a60b06-dfc6-4a55-8772-a39af13a64ba tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.163835 Aug 23 08:19:12.680079 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 151/297] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:12 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:13.265393 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:13.266123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:13.272330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:13.272916 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:13.273358 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:13.274062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:13.274549 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:13.275013 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:13.470392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:13.478831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-fe3f7c37-32c9-411c-824a-04fd8536f81e tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.218311 Aug 23 08:19:13.479913 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 147/298] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:13 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:13.704920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:13.706602 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:13.714649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:13.715463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:13.716304 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:13.717250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:13.717883 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:13.718528 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:13.875909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:13.884742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c8649d56-5816-4bad-858b-9d38471b33c9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.187881 Aug 23 08:19:13.885840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 152/299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:13 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:14.500389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:14.501221 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:14.507346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:14.507838 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:14.508273 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:14.508970 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:14.509421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:14.509848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:14.649580 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:14.656567 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:14.659432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0c4ec25e-c19a-46e8-9e74-0b3020c4fa37 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.163215 Aug 23 08:19:14.660535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 148/300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:14 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:14.906877 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:14.907516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:14.913805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:14.914284 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:14.914756 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:14.915587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:14.923960 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:14.923960 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:15.050831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:15.054060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:15.060554 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7fc6c5db-e213-4273-a70c-a65482e127da tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.158416 Aug 23 08:19:15.061161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 153/301] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:14 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:15.681941 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:15.682699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:15.690283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:15.690777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:15.691347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:15.692048 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:15.692746 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:15.692909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:15.854878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:15.866764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-daef9dcf-e911-411a-89f0-ff93027cef25 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.189925 Aug 23 08:19:15.867398 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 149/302] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:15 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:16.082072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:16.083347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:16.095718 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:16.096216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:16.098605 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:16.099357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:16.099821 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:16.100246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:16.257572 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:16.266016 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cc169e23-fff5-4c43-925c-f5eb310e2225 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.188643 Aug 23 08:19:16.266652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 154/303] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:16 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:16.888594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:16.889252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:16.897314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:16.897805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:16.898466 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:16.899498 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:16.900117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:16.900739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:17.113116 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:17.120682 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bf50756a-ded5-49e7-945a-cad4813c24d8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.236516 Aug 23 08:19:17.126181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 150/304] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:16 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:17.292849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:17.293445 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:17.302191 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:17.302753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:17.303351 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:17.304106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:17.304758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:17.305239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:17.443169 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:17.452196 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b1d4b76c-63e6-4d40-861b-da32bd9c7820 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.164004 Aug 23 08:19:17.452764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 155/305] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:17 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:18.141537 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:18.142093 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:18.148352 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:18.148826 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:18.149252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:18.149926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:18.150373 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:18.150793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:18.286456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:18.296728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8517b0b9-243f-4236-882a-5e2cf31b0043 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.158998 Aug 23 08:19:18.307652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 151/306] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:18 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:18.472839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:18.473637 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:18.480611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:18.481222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:18.481916 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:18.484785 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:18.487783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:18.487783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:18.632947 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:18.641230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bb87b8b4-4311-408b-9166-40a6dcf7e751 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.172270 Aug 23 08:19:18.641785 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 156/307] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:18 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:19.319240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:19.319888 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:19.325961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:19.326456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:19.326890 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:19.327607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:19.328063 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:19.328488 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:19.472643 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:19.481583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9c97d1e3-b34b-475a-a514-ca586245b3d2 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.166449 Aug 23 08:19:19.482282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 152/308] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:19 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:19.663331 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:19.664061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:19.672187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:19.672821 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:19.673359 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:19.674154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:19.674734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:19.675274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:20.146080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:20.169116 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2773198e-2b69-4b1c-8c73-81b171e5f61a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.510349 Aug 23 08:19:20.177454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 157/309] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:19 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:20.502139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:20.503585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:20.510288 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:20.513070 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:20.513070 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:20.513070 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:20.513070 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:20.513746 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:20.721767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:20.734524 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-22d49e6c-84bd-47eb-b671-7885fc58f840 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.236394 Aug 23 08:19:20.738304 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 153/310] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:20 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:21.201634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:21.201634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:21.222740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:21.223259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:21.223689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:21.224393 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:21.224827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:21.225234 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:21.391147 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:21.408638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-01bf641c-46a6-4d9e-8414-886d010a8f97 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.213301 Aug 23 08:19:21.409209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 158/311] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:21 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:21.761223 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:21.761923 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:21.768413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:21.769096 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:21.769528 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:21.770278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:21.770691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:21.771143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:21.994132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:22.002632 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-84f82f6d-54cd-4354-a903-3a3701d02410 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.246188 Aug 23 08:19:22.003234 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 154/312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:21 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:22.151578 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-e2f0594f-e425-4af2-8714-0f5109861955 req-7d082bd9-edb3-40ed-9c8e-64c58b319077 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e8dd2e-8677-468c-8c3a-fa7da1e0df0b", "name": "network-vif-plugged", "status": "completed", "tag": "b272b030-dc27-4475-b1cf-619ab9236556"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:22.161983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-e2f0594f-e425-4af2-8714-0f5109861955 req-7d082bd9-edb3-40ed-9c8e-64c58b319077 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:22.162456 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-e2f0594f-e425-4af2-8714-0f5109861955 req-7d082bd9-edb3-40ed-9c8e-64c58b319077 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:22.162969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-e2f0594f-e425-4af2-8714-0f5109861955 req-7d082bd9-edb3-40ed-9c8e-64c58b319077 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:22.175513 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-e2f0594f-e425-4af2-8714-0f5109861955 req-7d082bd9-edb3-40ed-9c8e-64c58b319077 service nova] Creating event network-vif-plugged:b272b030-dc27-4475-b1cf-619ab9236556 for instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b on hv-cinder-85407 Aug 23 08:19:22.181766 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-e2f0594f-e425-4af2-8714-0f5109861955 req-7d082bd9-edb3-40ed-9c8e-64c58b319077 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033242 Aug 23 08:19:22.182702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 159/313] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:19:22.429399 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:22.437702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:22.437702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:22.437702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:22.437702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:22.438820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:22.439961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:22.440624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:22.595808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:22.605309 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e7b07443-878e-4559-9630-ba4687d8b281 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.179687 Aug 23 08:19:22.605814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 155/314] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:22 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:23.024670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:23.026620 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:23.034579 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:23.035357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:23.035859 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:23.036954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:23.037477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:23.037812 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:23.175955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:23.184564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0079a733-2494-463d-ac87-945e69f16e47 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.163994 Aug 23 08:19:23.198445 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 160/315] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:23 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:23.625759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:23.626315 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:23.633113 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:23.638307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:23.638307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:23.638307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:23.638307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:23.638740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:23.800718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:23.809119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6e78a950-2ca4-452f-a526-ea97edf67282 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.187240 Aug 23 08:19:23.816487 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 156/316] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:23 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:24.214491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:24.215286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:24.234025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:24.234595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:24.237635 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:24.237635 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:24.237635 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:24.237635 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:24.400189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:24.410691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-05e7a4b0-e6d4-4a2a-b2f9-07ecdd744dc4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1314 microversion: 2.1 time: 0.200233 Aug 23 08:19:24.420085 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 161/317] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:24 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:24.839698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:24.840865 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:24.846616 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:24.847141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:24.847575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:24.848263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:24.848741 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:24.849127 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:24.995349 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:25.011671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8a032897-93b1-43e0-96b3-1d0c14bc2224 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.168770 Aug 23 08:19:25.011671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 157/318] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:24 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:25.434531 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:25.436408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:25.452480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:25.452480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:25.452480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:25.452480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:25.453014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:25.453014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:25.632629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:25.641133 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-92e34e8c-21cf-48e2-93de-3edfaeb4b5d9 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1498 microversion: 2.1 time: 0.213243 Aug 23 08:19:25.641742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 162/319] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:25 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1498 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:26.029773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:26.030334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:26.036129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:26.036607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:26.037033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:26.037707 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:26.038218 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:26.038619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:26.169010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:26.177042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2192d92c-bdf8-4807-a896-3e7fd37feb02 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.151206 Aug 23 08:19:26.177606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 158/320] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:26 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:27.200389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:27.201673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:27.210491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:27.211565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:27.212190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:27.213540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:27.214244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:27.214743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:27.280694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:27.282924 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:27.289976 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:27.291122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:27.291757 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:27.292685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:27.293340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:27.294071 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:27.328140 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:19:27.406227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:27.414403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f502301e-e1cf-4df3-9a32-e5a447acc42b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.219527 Aug 23 08:19:27.427117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 163/321] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:27 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:27.678707 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1779be2b-3e03-457c-a6b0-ffd0089b5a57 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "DELETE /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 204 len: 0 microversion: 2.1 time: 0.401492 Aug 23 08:19:27.679859 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 159/322] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:19:27 2022] DELETE /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 08:19:27.694751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:27.694751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:27.698185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:27.699752 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:27.700500 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:27.701439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:27.702107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:27.702903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:27.907699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:27.915865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e7c1b318-5c98-4dc6-af0d-217a5574a822 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1504 microversion: 2.1 time: 0.231384 Aug 23 08:19:27.916435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 164/323] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:27 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:28.435289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:28.435979 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:28.441762 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:28.442238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:28.442666 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:28.443368 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:28.443815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:28.444228 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:28.577043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:28.585143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1612d5b6-85d4-4fda-8756-ea3d2223fe22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.154151 Aug 23 08:19:28.585854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 160/324] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:28 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:28.936811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:28.937408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:28.943774 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:28.944245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:28.945173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:28.945845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:28.946287 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:28.946734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:29.103189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:29.113315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5e1401df-a917-4ddd-a28d-9a405515629d tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1504 microversion: 2.1 time: 0.180291 Aug 23 08:19:29.114101 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 165/325] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:28 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:29.609540 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:29.610377 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:29.617100 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:29.617797 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:29.618229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:29.618921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:29.619401 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:29.619827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:29.782931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:29.791494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bcd7e47d-afc5-43dd-a7d6-33c1f1a233c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.185683 Aug 23 08:19:29.792059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 161/326] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:29 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:30.110862 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-f7eba704-f550-4e75-a1d4-b2675e8e241a req-b9f32d62-1a92-47c0-bb5f-188b15f33a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83e8dd2e-8677-468c-8c3a-fa7da1e0df0b", "name": "network-vif-deleted", "tag": "b272b030-dc27-4475-b1cf-619ab9236556"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:30.127964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f7eba704-f550-4e75-a1d4-b2675e8e241a req-b9f32d62-1a92-47c0-bb5f-188b15f33a6a service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:30.130792 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f7eba704-f550-4e75-a1d4-b2675e8e241a req-b9f32d62-1a92-47c0-bb5f-188b15f33a6a service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:30.131374 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f7eba704-f550-4e75-a1d4-b2675e8e241a req-b9f32d62-1a92-47c0-bb5f-188b15f33a6a service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:30.134808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:30.135475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:30.142913 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:30.143101 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-f7eba704-f550-4e75-a1d4-b2675e8e241a req-b9f32d62-1a92-47c0-bb5f-188b15f33a6a service nova] Creating event network-vif-deleted:b272b030-dc27-4475-b1cf-619ab9236556 for instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b on hv-cinder-85407 Aug 23 08:19:30.143759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:30.144588 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:30.145639 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:30.147222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:30.148489 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:30.149140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-f7eba704-f550-4e75-a1d4-b2675e8e241a req-b9f32d62-1a92-47c0-bb5f-188b15f33a6a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042979 Aug 23 08:19:30.149726 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 166/327] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:19:30.216045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:30.223847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-85e2d692-563b-4562-a1ed-d73b7728f4dd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1462 microversion: 2.1 time: 0.092969 Aug 23 08:19:30.224405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 162/328] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:30 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:30.813300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:30.814220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:30.821190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:30.821501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:30.821928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:30.822620 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:30.823089 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:30.823511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:30.967846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:30.976524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8deae6b4-3c16-47c2-9734-00610358b7ef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.167323 Aug 23 08:19:30.977086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 167/329] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:30 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:31.246143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:31.246933 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:31.252897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:31.253655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:31.254085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:31.254971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:31.255431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:31.255868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:31.293057 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:31.305285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:31.307219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:31.307714 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:31.308182 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lazy-loading 'fault' on Instance uuid 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:19:31.313972 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:31.357850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:31.371170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9439ad17-5166-4461-90bd-4efac627b608 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 200 len: 1304 microversion: 2.1 time: 0.128757 Aug 23 08:19:31.371738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 163/330] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:31 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:31.996646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:31.997243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:32.007190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:32.007190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:32.007190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:32.007190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:32.007560 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:32.007560 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:32.148459 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:32.156129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-879b91c7-a142-40cd-93f3-aaf57cbd0e85 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.163315 Aug 23 08:19:32.156689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 168/331] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:31 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:32.393211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:32.393735 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:32.400329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:32.400803 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:32.401232 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:32.401907 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:32.402362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:32.402781 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:32.416257 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] HTTP exception thrown: Instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b could not be found. Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Request method failure captured: Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b HTTP/1.1 Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI1pDyHjMXCF_X95EPWdwWY8Q0iEaGrisWEatl3OpaSuD8hJ8YvLXR8dTxVnDi8tE4JH1AgJSQgnkYE2i-Nu-LK0J5qXjs1HFAgpkZS9ZGNdc40tw1U4hVsN-31PHkg5VrNeNjFN9RN9FzOtAljZ33urE-xCT8QiWFTy6GguFtAoZCM Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: cdbd04906d2b42fba52e61f3dbd0af21 Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-VolumesActionsTest-1460265089 Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:19:32.417869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cdbd04906d2b42fba52e61f3dbd0af21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cdbd04906d2b42fba52e61f3dbd0af21", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cdbd04906d2b42fba52e61f3dbd0af21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cdbd04906d2b42fba52e61f3dbd0af21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-VolumesActionsTest-1460265089 Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: cdbd04906d2b42fba52e61f3dbd0af21 Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-VolumesActionsTest-1460265089 Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-VolumesActionsTest-1460265089-project Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: 45777028be184247b0a58eee7d2c7e45 Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-VolumesActionsTest-1460265089-project Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b could not be found. Aug 23 08:19:32.422751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '83e8dd2e-8677-468c-8c3a-fa7da1e0df0b'} Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b could not be found. Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:19:32.423699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b could not be found. Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b could not be found. Aug 23 08:19:32.425129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:19:32.426564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Returning 404 to user: Instance 83e8dd2e-8677-468c-8c3a-fa7da1e0df0b could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:19:32.426564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c2f213ac-b6ec-4cfe-9608-02ce03f2b568 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b" status: 404 len: 111 microversion: 2.1 time: 0.030648 Aug 23 08:19:32.426564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 164/332] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:32 2022] GET /compute/v2.1/servers/83e8dd2e-8677-468c-8c3a-fa7da1e0df0b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 08:19:32.567584 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1663776107", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "networks": [{"uuid": "849e7e7d-9d32-4358-9c29-338e787c96fa"}]}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:32.637686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] validate_networks() for [('849e7e7d-9d32-4358-9c29-338e787c96fa', None, None, None, None, None)] {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:19:33.048950 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:19:33.049533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:19:33.050338 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:19:33.050824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:19:33.051334 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:19:33.065318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:33.065815 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:33.069790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:33.069790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:33.069790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:33.069790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:33.093960 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Getting quotas for project cdbd04906d2b42fba52e61f3dbd0af21. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:19:33.106699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Getting quotas for user 45777028be184247b0a58eee7d2c7e45 and project cdbd04906d2b42fba52e61f3dbd0af21. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:19:33.115462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:19:33.118356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:19:33.178157 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:33.179189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:33.190165 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:33.190804 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:33.191355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:33.192153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:33.192711 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:33.193258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:33.274021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c80b0d74-ac2f-4742-b037-5663055a4a49 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710145 Aug 23 08:19:33.275014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 169/333] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:19:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:19:33.291140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5711af63-723a-4323-ad1c-361d7330dfd4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:33.291850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5711af63-723a-4323-ad1c-361d7330dfd4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:33.460149 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5711af63-723a-4323-ad1c-361d7330dfd4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:33.474192 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5711af63-723a-4323-ad1c-361d7330dfd4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1214 microversion: 2.1 time: 0.190982 Aug 23 08:19:33.475673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 170/334] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:33 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:33.516278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:33.527809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7e5abe40-5ffc-414a-aba7-6ac794c037a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.352533 Aug 23 08:19:33.527809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 165/335] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:33 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:34.495791 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:34.496679 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:34.514412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:34.514932 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:34.515387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:34.516123 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:34.516606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:34.517033 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:34.546842 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:34.548474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:34.555242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:34.556269 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:34.558836 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:34.560869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:34.564761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:34.565456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:34.593944 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:34.611232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a104b45e-625e-4ed4-b012-03aea670f0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1218 microversion: 2.1 time: 0.113728 Aug 23 08:19:34.611232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 171/336] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:34 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1218 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:34.745149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:34.752990 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9b4f3f6d-37c6-464b-bee4-80d18c29b029 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.210083 Aug 23 08:19:34.753555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 166/337] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:34 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:35.628041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:35.628654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:35.635239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:35.635728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:35.636168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:35.636862 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:35.637318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:35.637890 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:35.698684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:35.706697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9546dd59-13eb-4950-a0ea-62d37058e0de tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1218 microversion: 2.1 time: 0.082451 Aug 23 08:19:35.707285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 172/338] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:35 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:35.775155 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:35.775859 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:35.782490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:35.783269 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:35.783802 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:35.784566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:35.785376 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:35.785564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:35.929445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:35.940122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3ec0e6ec-d464-408f-b67d-7f1b774e940a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1502 microversion: 2.1 time: 0.168790 Aug 23 08:19:35.940704 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 167/339] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:35 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:35.961809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6c4bfff-73aa-4bf9-ba69-ac19150aeaca"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:35.964329 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:35.971189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:35.971678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:35.972117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:35.972848 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:35.973305 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:35.973762 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:35.991523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:35.998062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] HTTP exception thrown: Cannot 'attach_volume' instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 while it is in vm_state rescued Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Request method failure captured: Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: POST /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8/os-volume_attachments HTTP/1.1 Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 74 Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI0BCWc2oRmFZ1_zUztLlLniSOHZHpEyOoVAXyhpSePuz5nzpZ6FXuN3fD3VReZe3nNTxgolkDgsAp1R3ShC1Ys-yJhdYL5m_4hgDoT1V9fakcuefZXvA-rn6Alpx9Pv-1WWTWriqZTXJDyjo-_jIbZPcNCVMRv7q8bknNFyG3yxtEc Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:19:35.999738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cfd891d8d1b7436fabfa2c48019c3565", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: b3c984088c0448f8abc0a0b60b820b3e Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {"volumeAttachment": {"volumeId": "e6c4bfff-73aa-4bf9-ba69-ac19150aeaca"}} Aug 23 08:19:36.001226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Cannot 'attach_volume' instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 while it is in vm_state rescued Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'server_id': 'bb12ae3d-e305-4628-a89c-7a6f95c07fa8', 'body': {'volumeAttachment': {'volumeId': 'e6c4bfff-73aa-4bf9-ba69-ac19150aeaca'}}} Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:19:36.002096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 while it is in vm_state rescued Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:19:36.003561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:19:36.004909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:19:36.004909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:19:36.004909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 while it is in vm_state rescued Aug 23 08:19:36.004909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:19:36.004909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Returning 409 to user: Cannot 'attach_volume' instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 while it is in vm_state rescued {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:19:36.004909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4c238e8e-686a-4b7d-a874-65e6c80e952a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044157 Aug 23 08:19:36.004909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 173/340] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:19:35 2022] POST /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 08:19:36.010835 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:36.011398 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:36.017444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:36.017924 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:36.023915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:36.023915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:36.023915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:36.023915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:36.261953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2b209e22-f938-466a-948d-a3dbf50fcf2c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8/action" status: 202 len: 0 microversion: 2.1 time: 0.254690 Aug 23 08:19:36.265779 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 168/341] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:19:36 2022] POST /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 08:19:36.270803 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:36.271856 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:36.278162 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:36.278629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:36.279083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:36.279757 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:36.280209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:36.280627 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:36.428480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:36.435747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-adbfcf74-209b-458c-8f28-042677b98a30 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.168669 Aug 23 08:19:36.436328 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 174/342] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:36 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:36.729021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:36.729707 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:36.735823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:36.736306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:36.736765 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:36.737472 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:36.737920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:36.738338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:36.799583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:36.807134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5862519b-fade-486b-86e3-840121d43794 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1210 microversion: 2.1 time: 0.083351 Aug 23 08:19:36.807693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 169/343] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:36 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:37.457315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:37.457957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:37.464566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:37.465045 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:37.465473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:37.471911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:37.471911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:37.471911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:37.602772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:37.610421 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d83b50bc-6a0b-47cd-a7f0-c6b29f01e67d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.157251 Aug 23 08:19:37.611005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 175/344] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:37 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:37.828583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:37.829196 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:37.835593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:37.836085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:37.836524 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:37.837270 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:37.837718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:37.838144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:37.898314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:37.905903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9811a29a-121b-45ec-8a73-5722834dbacd tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1210 microversion: 2.1 time: 0.081489 Aug 23 08:19:37.906460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 170/345] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:37 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:38.631581 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:38.632195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:38.634488 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:38.639150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:38.639637 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:38.640074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:38.640767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:38.641219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:38.641648 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:38.767180 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:38.774770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-67fee676-f191-49f9-8071-3269a1b980c3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.146998 Aug 23 08:19:38.775361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 176/346] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:38 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:38.928344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:38.938139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:38.938139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:38.938139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:38.938139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:38.938553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:38.938553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:38.938553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:39.015666 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:39.026276 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f3fcc9ba-3f6d-4a69-b3d2-2515b02053a8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1210 microversion: 2.1 time: 0.101974 Aug 23 08:19:39.027371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 171/347] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:38 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:39.796222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:39.797525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:39.804067 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:39.804775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:39.805263 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:39.806158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:39.806716 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:39.807250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:39.960152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:39.967758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-66efa94b-16be-45a2-8187-b2fdd32db4c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.175532 Aug 23 08:19:39.968312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 177/348] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:39 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:40.048090 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:40.048854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:40.056181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:40.056802 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:40.058350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:40.058350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:40.058845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:40.059449 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:40.132330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:40.151152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-37c06d5a-79d0-4e78-8b2e-ab1ab012f434 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1284 microversion: 2.1 time: 0.099034 Aug 23 08:19:40.155278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 172/349] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:40 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:40.988903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:40.989621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:40.996684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:40.997257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:40.997827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:40.998530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:40.999018 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:40.999450 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:41.161960 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:41.165246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:41.165857 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:41.170461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b1d80b39-2472-4eb7-b914-8887c1eba01e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.185619 Aug 23 08:19:41.171116 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 178/350] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:40 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:41.184539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:41.184539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:41.184539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:41.184539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:41.184964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:41.184964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:41.340474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:41.348632 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-34e5f52e-87d3-4ee5-bda1-00eb290dc88b tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1326 microversion: 2.1 time: 0.187186 Aug 23 08:19:41.350980 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 173/351] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:41 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1326 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:42.192224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:42.192821 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:42.198793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:42.199343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:42.199772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:42.200445 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:42.200896 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:42.201314 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:42.376945 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:42.377775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:42.378281 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:42.385985 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:42.386760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:42.387747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:42.388608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:42.389234 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:42.389687 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:42.390306 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8fa2a018-9ac6-4e30-93a3-25e630e84e04 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.201994 Aug 23 08:19:42.393348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 179/352] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:42 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:42.534171 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:42.541853 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f7cda9ea-7081-46e4-98de-18bbc9ff9b53 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1326 microversion: 2.1 time: 0.169562 Aug 23 08:19:42.542504 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 174/353] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:42 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1326 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:43.123517 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-1b04f268-0095-405c-976e-998f00ee557e req-ffd45a0b-f0ae-418d-8981-a2ae75a0075e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0231d07d-ffa7-445a-8802-9b45cd1f5bbb", "tag": "17c98b35-f103-449d-a8b9-063f95cf0e0d"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:43.130428 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:43.134843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-1b04f268-0095-405c-976e-998f00ee557e req-ffd45a0b-f0ae-418d-8981-a2ae75a0075e service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:43.135426 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-1b04f268-0095-405c-976e-998f00ee557e req-ffd45a0b-f0ae-418d-8981-a2ae75a0075e service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:43.135927 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-1b04f268-0095-405c-976e-998f00ee557e req-ffd45a0b-f0ae-418d-8981-a2ae75a0075e service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:43.147976 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-1b04f268-0095-405c-976e-998f00ee557e req-ffd45a0b-f0ae-418d-8981-a2ae75a0075e service nova] Creating event network-changed:17c98b35-f103-449d-a8b9-063f95cf0e0d for instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb on hv-cinder-85407 Aug 23 08:19:43.152854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-1b04f268-0095-405c-976e-998f00ee557e req-ffd45a0b-f0ae-418d-8981-a2ae75a0075e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033147 Aug 23 08:19:43.153499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 180/354] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:19:43.413851 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:43.414724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:43.422439 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:43.422439 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:43.422439 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:43.423329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:43.423791 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:43.424381 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:43.558218 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:43.559654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=8 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:43.563902 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:43.564608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:43.566135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1969f868-0119-4f1f-b588-f844f6380511 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.156834 Aug 23 08:19:43.566887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 175/355] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:43 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:43.571233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:43.571711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:43.572140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:43.572822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:43.573272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:43.573688 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:43.705226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:43.713426 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7ef9ab62-8335-4578-a3bd-cfbcdbf937bb tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.155195 Aug 23 08:19:43.713970 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 181/356] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:43 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:44.586965 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:44.587585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:44.593687 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:44.594174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:44.594630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:44.595328 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:44.595788 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:44.596211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:44.727697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:44.735685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-dde562a6-4320-49b8-9865-d33d53e23c9b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.152556 Aug 23 08:19:44.738226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 176/357] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:44 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:44.752467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:44.752467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:44.752467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:44.752467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:44.753622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:44.753622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:44.753622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:44.753622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:45.086264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:45.094290 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-59bf3844-206b-48e3-8877-5f6b6d9f64e4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.359007 Aug 23 08:19:45.095248 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 182/358] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:44 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:45.771181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:45.771795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:45.777770 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:45.778255 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:45.778691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:45.779593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:45.780049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:45.780471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:45.920597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:45.928736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-61c06041-d701-4233-b39f-dc393dac3866 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1510 microversion: 2.1 time: 0.162014 Aug 23 08:19:45.929428 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 177/359] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:45 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:46.114729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:46.115401 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:46.121763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:46.123439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:46.123439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:46.123439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:46.123810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:46.124232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:46.259650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:46.267329 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ac317991-dc75-4732-9b29-48e7e0153876 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.156416 Aug 23 08:19:46.267894 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 183/360] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:46 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:46.949911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:46.950531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:46.957003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:46.957498 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:46.957982 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:46.958644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:46.959122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:46.959550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:47.231378 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:47.239397 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6858398b-3258-4b5d-b6a0-1fdad9332d00 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1516 microversion: 2.1 time: 0.293250 Aug 23 08:19:47.239966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 178/361] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:46 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1516 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:47.290140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:47.293592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:47.307646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:47.308274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:47.308710 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:47.309645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:47.310005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:47.310417 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:47.470480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:47.483334 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-625de61f-2c41-4966-addd-8a6bb728fd98 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.199224 Aug 23 08:19:47.484198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 184/362] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:47 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:48.509433 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:48.510065 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:48.515967 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:48.516449 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:48.516882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:48.517564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:48.518015 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:48.518436 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:48.652402 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:48.656242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:48.672528 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6d976fc2-bb1f-4518-bad5-2a9b4fd351a7 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.166591 Aug 23 08:19:48.673085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 179/363] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:48 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:49.694070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:49.694827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:49.700970 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:49.704242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:49.704242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:49.704242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:49.704242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:49.704621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:49.855587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:49.863929 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6055c9dd-afa8-4453-aa6f-66648234a19c tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.174460 Aug 23 08:19:49.864499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 185/364] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:49 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:50.603743 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9abfd1b5-1e34-444b-96a3-9bc5d06391c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'create', calling method: .version_select at 0x7fa61a173310>, body: {"keypair": {"name": "tempest-keypair-603003347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqt6aca+1ytSa4V6Y9NlD/F5oFri3SdUynNxXZmB8N2Pw5HInJ4MRfuN91EZc4NAVps8V6YLPXbkA7ATUHeSX+R6XFwDw/kgmvf8u32P/VQZzUNqQ46MtlJVI6uON16ow=="}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:50.625254 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-9abfd1b5-1e34-444b-96a3-9bc5d06391c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Getting quotas for project cfd891d8d1b7436fabfa2c48019c3565. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:19:50.631694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-9abfd1b5-1e34-444b-96a3-9bc5d06391c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Getting quotas for user b3c984088c0448f8abc0a0b60b820b3e and project cfd891d8d1b7436fabfa2c48019c3565. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:19:50.764732 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9abfd1b5-1e34-444b-96a3-9bc5d06391c7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165504 Aug 23 08:19:50.765054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 180/365] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:19:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:19:50.888954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:50.889851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:50.900342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:50.900952 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:50.901628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:50.902422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:50.903142 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:50.903795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:51.074930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:51.083444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b0b88bcd-845c-4444-9590-916ac4ab6717 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.202681 Aug 23 08:19:51.084009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 186/366] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:50 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:52.112627 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:52.112627 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:52.117767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:52.118270 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:52.118724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:52.119926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:52.120717 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:52.121149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:52.266145 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:52.273871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-20870345-b03f-4f42-a67d-792f1ef86065 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.172604 Aug 23 08:19:52.274477 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 181/367] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:52 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:53.295997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:53.296747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:53.303700 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:53.304191 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:53.304626 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:53.305343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:53.305808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:53.306233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:53.455435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:53.463299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-75d39762-443c-48a2-974f-b89646fad18f tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.171377 Aug 23 08:19:53.463857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 187/368] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:53 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:53.797532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1047192284", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e15ce27b-69fc-4c64-88d5-5ba5f87f4649"}], "security_groups": [{"name": "tempest-securitygroup--742270298"}], "key_name": "tempest-keypair-603003347", "user_data": "}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:54.484255 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:54.484873 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:54.492101 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:54.492600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:54.493036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:54.493742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:54.494206 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:54.494626 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:54.635019 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:54.643860 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e11b4b93-a18f-4158-a37c-c99d81fc7ad1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.163606 Aug 23 08:19:54.644430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 188/369] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:54 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:54.771138 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-18c1ca1e-7b46-4c85-af23-f363da99e7e2 req-700ae3cf-9dd0-4960-bc0f-278f33eca640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0231d07d-ffa7-445a-8802-9b45cd1f5bbb", "name": "network-vif-plugged", "status": "completed", "tag": "17c98b35-f103-449d-a8b9-063f95cf0e0d"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:19:54.780370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-18c1ca1e-7b46-4c85-af23-f363da99e7e2 req-700ae3cf-9dd0-4960-bc0f-278f33eca640 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:54.780847 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-18c1ca1e-7b46-4c85-af23-f363da99e7e2 req-700ae3cf-9dd0-4960-bc0f-278f33eca640 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:54.781273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-18c1ca1e-7b46-4c85-af23-f363da99e7e2 req-700ae3cf-9dd0-4960-bc0f-278f33eca640 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:54.792222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-18c1ca1e-7b46-4c85-af23-f363da99e7e2 req-700ae3cf-9dd0-4960-bc0f-278f33eca640 service nova] Creating event network-vif-plugged:17c98b35-f103-449d-a8b9-063f95cf0e0d for instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb on hv-cinder-85407 Aug 23 08:19:54.797330 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-18c1ca1e-7b46-4c85-af23-f363da99e7e2 req-700ae3cf-9dd0-4960-bc0f-278f33eca640 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030026 Aug 23 08:19:54.801603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 189/370] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:19:55.665525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:55.666396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:55.673147 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:55.673633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:55.674067 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:55.674761 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:55.675245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:55.675667 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:55.809185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:55.817592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-318b249b-df3d-48d6-be62-648a6287b3e1 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.156283 Aug 23 08:19:55.818156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 190/371] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:55 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:56.848654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:56.849331 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:56.858654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:56.859194 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:56.859632 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:56.861003 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:56.861460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:56.861884 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:56.993964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:57.000012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:19:57.004548 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fffc56b8-4253-49e4-be35-ed7a0c281996 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1314 microversion: 2.1 time: 0.168486 Aug 23 08:19:57.005103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 191/372] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:56 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:19:58.027883 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:58.028631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:58.036349 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:58.036836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:58.037376 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:58.038229 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:58.038787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:58.039327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:58.180580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:19:58.189406 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e4a9b7ef-25be-43c0-bb3b-799eaac0f5a0 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1498 microversion: 2.1 time: 0.166456 Aug 23 08:19:58.190063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 192/373] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:58 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:19:59.486983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:59.487700 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:59.493816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:59.494300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:59.494733 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:59.495519 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:59.495975 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:59.496401 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:59.523274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:19:59.929903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d5a174d4-f9e5-4fd1-97a9-33786e9808dc tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 204 len: 0 microversion: 2.1 time: 0.446956 Aug 23 08:19:59.930494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 193/374] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:19:59 2022] DELETE /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:19:59.943693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:19:59.944681 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:19:59.951126 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:59.951699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:59.952198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:19:59.953458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:19:59.954177 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:19:59.954661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:00.116729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:00.129078 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3e1e52ff-4f34-4ce3-85ca-3e21d7958151 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1504 microversion: 2.1 time: 0.189590 Aug 23 08:20:00.130055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 194/375] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:19:59 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:20:00.648846 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=4 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:01.152222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:01.153075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:01.159591 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:01.160143 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:01.160573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:01.161269 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:01.161715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:01.162131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:01.177251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] validate_networks() for [('e15ce27b-69fc-4c64-88d5-5ba5f87f4649', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:20:01.382391 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:01.391264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-16ae4548-271d-4e6b-b8bb-d2418a123a23 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1504 microversion: 2.1 time: 0.242284 Aug 23 08:20:01.392153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 195/376] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:01 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1504 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:20:01.658532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:20:01.659162 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:20:01.659446 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:20:01.659857 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:20:01.660274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:20:01.669130 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:01.669613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:01.670048 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:01.670774 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:01.671290 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:01.671722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:01.688678 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Getting quotas for project cfd891d8d1b7436fabfa2c48019c3565. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:20:01.692639 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Getting quotas for user b3c984088c0448f8abc0a0b60b820b3e and project cfd891d8d1b7436fabfa2c48019c3565. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:20:01.704365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:20:01.706644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:20:01.869758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6c2d4dd5-9558-4b64-b0d5-b39c1d94559c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 8.076507 Aug 23 08:20:01.876959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 182/377] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:19:53 2022] POST /compute/v2.1/servers => generated 408 bytes in 8084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:20:01.883280 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9c0ccc39-63f0-493f-9548-7d14748188dd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:01.884217 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9c0ccc39-63f0-493f-9548-7d14748188dd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:01.950626 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9c0ccc39-63f0-493f-9548-7d14748188dd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:01.958564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9c0ccc39-63f0-493f-9548-7d14748188dd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1245 microversion: 2.1 time: 0.080084 Aug 23 08:20:01.960143 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 196/378] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:01 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:20:02.413001 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:02.413578 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:02.420753 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:02.421412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:02.421850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:02.422542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:02.423030 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:02.423458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:02.571918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:02.581107 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e10fa936-fdb3-413d-a242-e0ae72e33cf4 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1504 microversion: 2.1 time: 0.171954 Aug 23 08:20:02.581752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 183/379] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:02 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:02.890577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-61af8289-378d-469f-a546-62738aba7b1b req-39087ed9-5ce2-4e1c-8f7a-07e6514e1afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0231d07d-ffa7-445a-8802-9b45cd1f5bbb", "name": "network-vif-deleted", "tag": "17c98b35-f103-449d-a8b9-063f95cf0e0d"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:20:02.901328 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-61af8289-378d-469f-a546-62738aba7b1b req-39087ed9-5ce2-4e1c-8f7a-07e6514e1afb service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:02.902030 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-61af8289-378d-469f-a546-62738aba7b1b req-39087ed9-5ce2-4e1c-8f7a-07e6514e1afb service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:02.902459 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-61af8289-378d-469f-a546-62738aba7b1b req-39087ed9-5ce2-4e1c-8f7a-07e6514e1afb service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:02.913163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-61af8289-378d-469f-a546-62738aba7b1b req-39087ed9-5ce2-4e1c-8f7a-07e6514e1afb service nova] Creating event network-vif-deleted:17c98b35-f103-449d-a8b9-063f95cf0e0d for instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb on hv-cinder-85407 Aug 23 08:20:02.918859 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-61af8289-378d-469f-a546-62738aba7b1b req-39087ed9-5ce2-4e1c-8f7a-07e6514e1afb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032299 Aug 23 08:20:02.919606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 197/380] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:20:02.979596 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:02.980424 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:02.986673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:02.987142 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:02.987583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:02.988281 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:02.988745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:02.989301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:03.055723 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:03.063715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-fae35cd5-9805-4c00-baca-8b2920ca8642 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1249 microversion: 2.1 time: 0.087818 Aug 23 08:20:03.064629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 184/381] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:02 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:03.604831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:03.605532 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:03.612217 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:03.612699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:03.613134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:03.613821 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:03.614277 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:03.614739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:03.645354 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:03.645776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:03.646213 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:03.646662 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lazy-loading 'fault' on Instance uuid 0231d07d-ffa7-445a-8802-9b45cd1f5bbb {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:20:03.691086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45777028be184247b0a58eee7d2c7e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdbd04906d2b42fba52e61f3dbd0af21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:03.698903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-07c453bb-b0d4-48b7-b316-9de23cd00ad8 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 200 len: 1304 microversion: 2.1 time: 0.098423 Aug 23 08:20:03.699485 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 198/382] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:03 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:04.084766 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:04.085381 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:04.087253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:04.092080 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:04.093201 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:04.093644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:04.094345 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:04.094810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:04.095280 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:04.165694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:04.178207 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-705bf2d0-940f-4b8f-9f3d-d8606f82eb5d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1297 microversion: 2.1 time: 0.097101 Aug 23 08:20:04.180164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 185/383] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:04 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1297 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:04.722805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:04.724410 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] [instance: 0231d07d-ffa7-445a-8802-9b45cd1f5bbb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:04.731239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:04.731858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:04.732783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:04.734173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:04.734769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:04.735322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:04.753750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] HTTP exception thrown: Instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb could not be found. Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Request method failure captured: Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb HTTP/1.1 Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI1pDyHjMXCF_X95EPWdwWY8Q0iEaGrisWEatl3OpaSuD8hJ8YvLXR8dTxVnDi8tE4JH1AgJSQgnkYE2i-Nu-LK0J5qXjs1HFAgpkZS9ZGNdc40tw1U4hVsN-31PHkg5VrNeNjFN9RN9FzOtAljZ33urE-xCT8QiWFTy6GguFtAoZCM Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: cdbd04906d2b42fba52e61f3dbd0af21 Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesActionsTest-1460265089 Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:20:04.756566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cdbd04906d2b42fba52e61f3dbd0af21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cdbd04906d2b42fba52e61f3dbd0af21", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cdbd04906d2b42fba52e61f3dbd0af21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cdbd04906d2b42fba52e61f3dbd0af21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesActionsTest-1460265089 Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: cdbd04906d2b42fba52e61f3dbd0af21 Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesActionsTest-1460265089 Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesActionsTest-1460265089-project Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 45777028be184247b0a58eee7d2c7e45 Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesActionsTest-1460265089-project Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb could not be found. Aug 23 08:20:04.758198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '0231d07d-ffa7-445a-8802-9b45cd1f5bbb'} Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb could not be found. Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:20:04.759242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb could not be found. Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb could not be found. Aug 23 08:20:04.760708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:20:04.761854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] Returning 404 to user: Instance 0231d07d-ffa7-445a-8802-9b45cd1f5bbb could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:20:04.761854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6a701464-9bd0-4236-bb07-7f7b8bd0fd60 tempest-VolumesActionsTest-1460265089 tempest-VolumesActionsTest-1460265089-project] 10.222.0.58 "GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb" status: 404 len: 111 microversion: 2.1 time: 0.039944 Aug 23 08:20:04.761854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 199/384] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:04 2022] GET /compute/v2.1/servers/0231d07d-ffa7-445a-8802-9b45cd1f5bbb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:20:05.202642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:05.204025 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:05.213763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:05.213867 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:05.214234 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:05.215441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:05.216034 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:05.216576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:05.395289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:05.479850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8dcdd6b0-62a2-4cb0-bc17-2f25fcadff7b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.283287 Aug 23 08:20:05.485164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 186/385] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:05 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:06.400061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-c396da07-9c01-4e25-bb45-18a22a90a08b req-a854950d-93d2-4378-9f1b-bef37f5fec57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3184a3f4-7eb5-47f7-8cf6-74e4848f11dd", "tag": "d0bb753d-02ab-4eee-bd85-09531cfa16df"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:20:06.424481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-c396da07-9c01-4e25-bb45-18a22a90a08b req-a854950d-93d2-4378-9f1b-bef37f5fec57 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:06.425024 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-c396da07-9c01-4e25-bb45-18a22a90a08b req-a854950d-93d2-4378-9f1b-bef37f5fec57 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:06.425505 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-c396da07-9c01-4e25-bb45-18a22a90a08b req-a854950d-93d2-4378-9f1b-bef37f5fec57 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:06.436955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-c396da07-9c01-4e25-bb45-18a22a90a08b req-a854950d-93d2-4378-9f1b-bef37f5fec57 service nova] Creating event network-changed:d0bb753d-02ab-4eee-bd85-09531cfa16df for instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd on hv-cinder-85407 Aug 23 08:20:06.441779 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-c396da07-9c01-4e25-bb45-18a22a90a08b req-a854950d-93d2-4378-9f1b-bef37f5fec57 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045777 Aug 23 08:20:06.442498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 200/386] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:20:06.503938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:06.505210 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:06.511503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:06.511998 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:06.512429 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:06.513301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:06.513758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:06.514563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:06.656364 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:06.664205 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ef8ec16e-6e1f-45c4-b455-960771f2dca7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.164126 Aug 23 08:20:06.664755 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 187/387] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:06 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:07.686222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:07.686913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:07.693045 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:07.693529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:07.693968 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:07.694690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:07.695364 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:07.695786 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:07.828688 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:07.836465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6a50c779-184b-468c-ae01-4656db5b319c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.154994 Aug 23 08:20:07.837028 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 201/388] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:07 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:20:08.862637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:08.863353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:08.869274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:08.869758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:08.870195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:08.870907 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:08.871397 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:08.871817 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:09.014119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:09.021664 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-be5e3c26-4c53-4157-8f78-8d5da131195c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.162856 Aug 23 08:20:09.022216 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 188/389] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:08 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:10.042784 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:10.043350 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:10.046388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:10.051372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:10.051936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:10.061724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:10.061724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:10.061724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:10.061724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:10.180979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:10.189053 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1bc4d81f-0a4e-4e34-89ae-a57eb83c2936 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.150239 Aug 23 08:20:10.189820 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 202/390] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:10 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:11.209521 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:11.210045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:11.216151 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:11.216636 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:11.217081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:11.217765 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:11.218222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:11.218646 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:11.366452 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:11.371475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-739a9d9f-ca73-4172-a457-62a785aa2368 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.165845 Aug 23 08:20:11.372113 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 189/391] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:11 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:12.393259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:12.394453 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:12.397408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:12.401299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:12.401787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:12.402217 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:12.402908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:12.403395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:12.404162 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:12.536833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:12.544582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-243f9cf1-1f30-4083-82e6-e64708cc338f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.155415 Aug 23 08:20:12.545457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 203/392] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:12 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:13.566670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:13.567292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:13.569179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:13.569843 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=6 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:13.575028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:13.575535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:13.576005 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:13.576703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:13.577163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:13.577591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:13.706788 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:13.714366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f6687054-3138-4872-a889-eb168a6d3207 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.151786 Aug 23 08:20:13.714926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 190/393] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:13 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:14.734780 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:14.735440 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:14.741943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:14.742421 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:14.742846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:14.743547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:14.743993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:14.744407 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:14.872786 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:14.880385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-98a82d6e-3a56-4baa-a816-137dde9f66e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.150088 Aug 23 08:20:14.880959 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 204/394] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:14 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:15.901132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:15.901736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:15.907694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:15.909938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:15.909938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:15.909938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:15.909938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:15.910307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:16.035641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:16.043039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3dfcf5f6-062c-4c05-b8d4-eb0ad47b1f0b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.145740 Aug 23 08:20:16.043591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 191/395] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:15 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:17.063693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:17.064562 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:17.071106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:17.071595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:17.072031 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:17.072974 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:17.073423 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:17.073848 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:17.222671 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:17.230593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ff17124a-8c01-47b8-be9b-99c3f10d56ed tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.170702 Aug 23 08:20:17.231217 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 205/396] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:17 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:18.252068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:18.253470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:18.259912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:18.260426 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:18.260895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:18.261626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:18.262105 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:18.262548 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:18.413092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:18.422877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ecfb9bfe-b773-46e8-83c3-1d1af46b68b9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.174894 Aug 23 08:20:18.423570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 192/397] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:18 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:19.444068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:19.445323 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:19.452475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:19.458044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:19.458044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:19.458044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:19.458044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:19.458486 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:19.608702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:19.617019 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2a9816c0-48c5-442c-aa65-f8651f390bc3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.177002 Aug 23 08:20:19.617599 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 206/398] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:19 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:20.638908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:20.640250 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:20.646917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:20.647745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:20.648278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:20.649076 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:20.649622 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:20.650145 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:20.860319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:20.868183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e4640134-ab82-4bab-9d59-13e2ed4c826f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.233095 Aug 23 08:20:20.869010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 193/399] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:20 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:21.891051 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:21.892159 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:21.899127 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:21.899811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:21.900431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:21.901126 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:21.901588 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:21.902012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:22.055314 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:22.070541 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-938d4c61-2158-49e5-bf8f-c3a86a87ece4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.177666 Aug 23 08:20:22.071586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 207/400] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:21 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:23.097391 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:23.099455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:23.109003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:23.109629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:23.110356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:23.111355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:23.112221 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:23.112643 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:23.359121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:23.364316 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c4cea1a4-2f10-4b2a-8518-ac11aed3f086 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.273271 Aug 23 08:20:23.374971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 194/401] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:23 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:23.591818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-b3161c6a-477d-420b-9dd6-e76b1a5d7422 req-0e4fe282-4602-4e02-bdf6-1476ec54eaa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3184a3f4-7eb5-47f7-8cf6-74e4848f11dd", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb753d-02ab-4eee-bd85-09531cfa16df"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:20:23.611058 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-b3161c6a-477d-420b-9dd6-e76b1a5d7422 req-0e4fe282-4602-4e02-bdf6-1476ec54eaa8 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:23.614259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-b3161c6a-477d-420b-9dd6-e76b1a5d7422 req-0e4fe282-4602-4e02-bdf6-1476ec54eaa8 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:23.614259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-b3161c6a-477d-420b-9dd6-e76b1a5d7422 req-0e4fe282-4602-4e02-bdf6-1476ec54eaa8 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:23.629332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-b3161c6a-477d-420b-9dd6-e76b1a5d7422 req-0e4fe282-4602-4e02-bdf6-1476ec54eaa8 service nova] Creating event network-vif-plugged:d0bb753d-02ab-4eee-bd85-09531cfa16df for instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd on hv-cinder-85407 Aug 23 08:20:23.635290 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-b3161c6a-477d-420b-9dd6-e76b1a5d7422 req-0e4fe282-4602-4e02-bdf6-1476ec54eaa8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046779 Aug 23 08:20:23.637350 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 208/402] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:20:24.392521 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:24.395571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:24.406310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:24.407133 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:24.419136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:24.419136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:24.419136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:24.419136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:24.419620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=81 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:24.617555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:24.627907 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-69bc2acc-e2c9-462b-8fe6-ea5dbf1a63b3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.242510 Aug 23 08:20:24.628640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 195/403] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:24 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:25.650367 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:25.651109 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:25.657271 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:25.657749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:25.658183 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:25.658864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:25.659349 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:25.659772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:25.790744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:25.798924 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ff0fbaa0-98d5-45fd-937e-d9784d9d5e4b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.153234 Aug 23 08:20:25.799511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 209/404] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:25 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:26.819628 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:26.820927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:26.828289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:26.828856 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:26.829310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:26.830033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:26.830469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:26.830895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:26.975012 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:26.987514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-492c1713-1277-47d1-8b90-efefba2e77a6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.171603 Aug 23 08:20:26.988143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 196/405] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:26 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:28.009594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:28.010934 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:28.018690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:28.019484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:28.019925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:28.020629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:28.021085 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:28.021534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:28.026042 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:20:28.183311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:28.191628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3cfa05e3-f7bd-43ed-8278-aa90f9bc2670 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.186265 Aug 23 08:20:28.192200 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 210/406] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:28 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:29.221216 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:29.222719 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:29.232452 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:29.233721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:29.234535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:29.235581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:29.236144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:29.236582 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:29.403550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:29.411958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e3be9dc8-daec-4a30-b419-29cf3adbb0e4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.201498 Aug 23 08:20:29.415055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 197/407] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:29 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:30.432327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:30.433062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:30.442504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:30.443112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:30.443753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:30.444689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:30.445341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:30.446227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:30.599098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:30.610193 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b169a1b2-7bd4-41a1-accd-91d466e97189 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.181792 Aug 23 08:20:30.611031 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 211/408] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:30 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:20:31.631001 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:31.631716 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:31.659872 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:31.661316 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:31.663210 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:31.665264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:31.666853 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:31.672946 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:31.814683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:31.823262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-beaf8a70-96ae-4cef-90b2-603539b22a8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1370 microversion: 2.1 time: 0.195999 Aug 23 08:20:31.824045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 198/409] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:31 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:20:32.845840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:32.846673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:32.877104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:32.879727 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:32.881869 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:32.883542 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:32.884169 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:32.886244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:33.060110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:20:33.069461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-364814a9-69ff-4819-84bb-2f52d04b6e38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1565 microversion: 2.1 time: 0.227749 Aug 23 08:20:33.070107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 212/410] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:20:32 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:20:33.090971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:20:33.093421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:20:33.098422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:33.099211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:33.099891 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:33.100859 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:33.101692 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:33.102122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:33.192682 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ce7fae5b-6116-45d8-a520-1e3614c9651a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104143 Aug 23 08:20:33.193303 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 199/411] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Aug 23 08:20:33 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:20:34.403246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-97a6ab6c-ef59-4bf1-92da-a8f0193a86ee req-1df8f5f7-856b-45b1-9fb8-d7aecf4fa2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3184a3f4-7eb5-47f7-8cf6-74e4848f11dd", "tag": "d0bb753d-02ab-4eee-bd85-09531cfa16df"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:20:34.422567 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-97a6ab6c-ef59-4bf1-92da-a8f0193a86ee req-1df8f5f7-856b-45b1-9fb8-d7aecf4fa2e4 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:20:34.423134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-97a6ab6c-ef59-4bf1-92da-a8f0193a86ee req-1df8f5f7-856b-45b1-9fb8-d7aecf4fa2e4 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:20:34.423822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-97a6ab6c-ef59-4bf1-92da-a8f0193a86ee req-1df8f5f7-856b-45b1-9fb8-d7aecf4fa2e4 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:20:34.438278 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-97a6ab6c-ef59-4bf1-92da-a8f0193a86ee req-1df8f5f7-856b-45b1-9fb8-d7aecf4fa2e4 service nova] Creating event network-changed:d0bb753d-02ab-4eee-bd85-09531cfa16df for instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd on hv-cinder-85407 Aug 23 08:20:34.444694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-97a6ab6c-ef59-4bf1-92da-a8f0193a86ee req-1df8f5f7-856b-45b1-9fb8-d7aecf4fa2e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046619 Aug 23 08:20:34.446358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 213/412] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:21:05.033978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=29 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:05.034784 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=27 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:05.038693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-11982574", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "networks": [{"uuid": "22b0218f-c6dc-43aa-90b7-325e4ad9a48c"}]}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:05.091173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] validate_networks() for [('22b0218f-c6dc-43aa-90b7-325e4ad9a48c', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:21:05.120843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1205573697", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:05.128015 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=23 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:05.128661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=18 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:05.173800 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] validate_networks() for None {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:21:05.766544 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:21:05.766973 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:21:05.767442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:21:05.767843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:21:05.768246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:21:05.777389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:05.777866 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:05.778295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:05.779038 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:05.779494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:05.779911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:05.796398 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Getting quotas for project 1e8586b18aaa47f598a11b272031217a. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:21:05.800185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Getting quotas for user fe286cbe88934741822be3f74870b302 and project 1e8586b18aaa47f598a11b272031217a. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:21:05.811889 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:21:05.814342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:21:05.845194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:21:05.845620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:21:05.846092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:21:05.846622 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:21:05.847063 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:21:05.855691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:05.856217 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:05.856649 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:05.857512 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:05.858177 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:05.858627 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:05.878651 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Getting quotas for project ee175b1f398844f6be0075d3e127e8b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:21:05.884435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Getting quotas for user a0a59ef94e054c3d8175e1c0f1ad783a and project ee175b1f398844f6be0075d3e127e8b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:21:05.897061 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:21:05.898748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:21:05.958402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c993a48f-ce79-4849-aca8-829b28535943 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841862 Aug 23 08:21:05.959090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 214/413] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 08:21:05.970154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fe719f43-2642-46f7-82dd-89ccf7d0fcac tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:05.970749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fe719f43-2642-46f7-82dd-89ccf7d0fcac tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:06.031509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-fe719f43-2642-46f7-82dd-89ccf7d0fcac tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:06.038671 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fe719f43-2642-46f7-82dd-89ccf7d0fcac tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1215 microversion: 2.1 time: 0.072808 Aug 23 08:21:06.040801 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 215/414] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:05 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:06.058905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f0322032-7715-4763-8c46-b5c8be045aa5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.025675 Aug 23 08:21:06.059940 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 200/415] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:21:06.070908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-322a7d14-ef54-4401-91dc-9ca3e004b973 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:06.072103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-322a7d14-ef54-4401-91dc-9ca3e004b973 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:06.150596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-322a7d14-ef54-4401-91dc-9ca3e004b973 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:06.158285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-322a7d14-ef54-4401-91dc-9ca3e004b973 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1217 microversion: 2.1 time: 0.091611 Aug 23 08:21:06.158788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 216/416] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:06 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:06.823820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:06.824483 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:06.830827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:06.831364 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:06.831804 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:06.832509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:06.832970 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:06.833457 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:06.861047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-737dcf29-220a-42af-be1a-52ceded02fb8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/ips" status: 200 len: 151 microversion: 2.20 time: 0.039275 Aug 23 08:21:06.861047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 201/417] 10.222.0.58 () {60 vars in 1289 bytes} [Tue Aug 23 08:21:06 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:21:07.060797 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-04b45d03-d88b-4505-9f9c-9adf9ab61852 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:07.061402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-04b45d03-d88b-4505-9f9c-9adf9ab61852 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:07.124549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-04b45d03-d88b-4505-9f9c-9adf9ab61852 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:07.131928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-04b45d03-d88b-4505-9f9c-9adf9ab61852 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1215 microversion: 2.1 time: 0.075027 Aug 23 08:21:07.132477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 217/418] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:07 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:07.178048 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-de0ac7cb-e0e7-4fff-81a2-7a42c865842e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:07.179485 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-de0ac7cb-e0e7-4fff-81a2-7a42c865842e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:07.236389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-de0ac7cb-e0e7-4fff-81a2-7a42c865842e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:07.240206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-de0ac7cb-e0e7-4fff-81a2-7a42c865842e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1217 microversion: 2.1 time: 0.066181 Aug 23 08:21:07.240773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 202/419] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:07 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1217 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:08.153921 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:08.154607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:08.161569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:08.162223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:08.162784 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:08.163679 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:08.164129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:08.164544 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:08.227503 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:08.235990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-16f9f2c9-b266-4acb-9607-144fe3380e48 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1211 microversion: 2.1 time: 0.086730 Aug 23 08:21:08.236673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 218/420] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:08 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1211 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:08.261065 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:08.261677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:08.268125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:08.268617 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:08.269053 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:08.269755 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:08.270220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:08.270652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:08.335165 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:08.344828 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-296e2d75-a45b-4e80-9f09-75789df42a81 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1213 microversion: 2.1 time: 0.087353 Aug 23 08:21:08.345390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 203/421] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:08 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:09.257122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:09.257735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:09.266084 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:09.266582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:09.267046 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:09.267755 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:09.268212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:09.268639 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:09.353732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:09.362869 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fad7139c-75d3-47e2-b69b-2c8f4ab1f5a7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1275 microversion: 2.1 time: 0.109575 Aug 23 08:21:09.364265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 219/422] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:09 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:09.372882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:09.374289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:09.381548 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:09.382199 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:09.382655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:09.383514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:09.384134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:09.384664 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:09.465953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:09.474707 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b065e650-3639-4964-ba82-ab97c1590f44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1277 microversion: 2.1 time: 0.112911 Aug 23 08:21:09.476027 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 204/423] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:09 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:10.384540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:10.385151 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:10.393387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:10.393638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:10.394058 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:10.394764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:10.395816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:10.395816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:10.458607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:10.466950 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f740b3af-885c-4e1b-b666-f760bb034c6b tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1273 microversion: 2.1 time: 0.086589 Aug 23 08:21:10.467572 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 220/424] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:10 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:10.498509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:10.499520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:10.512494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:10.516594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:10.516594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:10.516594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:10.516594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:10.516930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:10.593827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:10.601677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-dac7de14-e72d-43f3-abb1-d308862d43ea tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1275 microversion: 2.1 time: 0.107812 Aug 23 08:21:10.603896 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 205/425] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:10 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1275 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:10.655294 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:10.655925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:10.662100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:10.662799 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:10.663329 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:10.664088 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:10.664619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:10.665111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:10.688736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lazy-loading 'flavor' on Instance uuid 895b9968-c8a0-4035-82f3-15a6726d65ed {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:21:11.359134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c776030a-9442-4aa3-94c5-b40d41c6b406 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/action" status: 202 len: 0 microversion: 2.20 time: 0.707607 Aug 23 08:21:11.359731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 221/426] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Aug 23 08:21:10 2022] POST /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:21:11.368722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:11.369606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:11.376252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:11.376884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:11.377661 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:11.378373 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:11.379045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:11.379581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:11.488597 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:11.489655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:11.497420 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:11.498184 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:11.498628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:11.499359 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:11.499987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:11.500561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:11.518635 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:11.528395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:11.530263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:11.531703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3834512c-afce-48b6-af95-4affb2f830f9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.167535 Aug 23 08:21:11.532252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 206/427] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:11 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:21:11.628028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:11.628927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:11.641651 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:11.642158 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:11.642654 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:11.645056 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:11.645739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:11.646615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:11.673817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:11.682424 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a23c2709-4bf8-4a42-94bd-73a732ddddf8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.198591 Aug 23 08:21:11.683929 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 222/428] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:11 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:11.810476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:11.818556 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b21d80d2-3020-43da-93f7-0d61499db18c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.196832 Aug 23 08:21:11.819131 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 207/429] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:11 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:12.154266 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-175353d0-506b-45cd-83c8-1350c5b069ab req-a045aed1-70e4-4c44-b769-faae90b6a036 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f551e6-2e0d-4d2c-a539-007f40fc0b2a", "tag": "f9684eb6-9cdc-4571-81b6-89a182589779"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:12.165880 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-175353d0-506b-45cd-83c8-1350c5b069ab req-a045aed1-70e4-4c44-b769-faae90b6a036 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:12.167079 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-175353d0-506b-45cd-83c8-1350c5b069ab req-a045aed1-70e4-4c44-b769-faae90b6a036 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:12.167747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-175353d0-506b-45cd-83c8-1350c5b069ab req-a045aed1-70e4-4c44-b769-faae90b6a036 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:12.189033 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-175353d0-506b-45cd-83c8-1350c5b069ab req-a045aed1-70e4-4c44-b769-faae90b6a036 service nova] Creating event network-changed:f9684eb6-9cdc-4571-81b6-89a182589779 for instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a on hv-cinder-85407 Aug 23 08:21:12.196804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-175353d0-506b-45cd-83c8-1350c5b069ab req-a045aed1-70e4-4c44-b769-faae90b6a036 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047034 Aug 23 08:21:12.198045 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 223/430] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:21:12.561082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:12.561875 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:12.569136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:12.569600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:12.570028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:12.570717 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:12.571195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:12.571616 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:12.707815 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:12.708489 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:12.708768 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:12.715961 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:12.716441 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:12.717061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:12.717953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:12.718402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:12.719023 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:12.719864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:12.721846 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:12.723912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-305833a5-5a93-402b-af16-652da361403f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.166796 Aug 23 08:21:12.724884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 208/431] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:12 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:12.841410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:12.842293 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:12.850018 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:12.850518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:12.851113 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:12.852039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:12.852320 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:12.852745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:12.971460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:12.980582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-88c21ec3-e3d3-4398-a568-d74708165b7d tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.278693 Aug 23 08:21:12.994454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 224/432] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:12 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:13.045615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:13.053579 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6bbd316c-8806-4499-8bdf-cd1ba1d79d95 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.217821 Aug 23 08:21:13.054196 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 209/433] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:12 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:13.749906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:13.750514 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:13.757148 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:13.757641 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:13.758080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:13.758775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:13.759257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:13.759687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:13.888466 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:13.896523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:13.898042 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:13.899231 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-33350928-691f-4b2f-b432-27fe2f45fc48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.153274 Aug 23 08:21:13.899788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 225/434] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:13 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:14.001408 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:14.002049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:14.007973 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:14.008456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:14.008897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:14.009582 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:14.010038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:14.010457 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:14.074983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:14.075598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:14.081499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:14.081981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:14.082433 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:14.083137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:14.083594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:14.084036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:14.169951 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:14.178818 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5eb45d54-a6fa-431f-97d3-38dd72f8db6f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.181067 Aug 23 08:21:14.179769 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 210/435] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:13 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:14.212695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-8bfd82fc-b9ff-4f18-b431-8e66f9880b07 req-d4cd8fc7-9785-4057-b80a-73085834f501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc318533-6346-493b-a0b4-c5920b0afefb", "tag": "45a86e4c-4b29-4cf5-9d39-a17035e4def7"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:14.226543 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-8bfd82fc-b9ff-4f18-b431-8e66f9880b07 req-d4cd8fc7-9785-4057-b80a-73085834f501 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:14.227581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-8bfd82fc-b9ff-4f18-b431-8e66f9880b07 req-d4cd8fc7-9785-4057-b80a-73085834f501 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:14.230061 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-8bfd82fc-b9ff-4f18-b431-8e66f9880b07 req-d4cd8fc7-9785-4057-b80a-73085834f501 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:14.233133 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:14.240778 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ba68dab5-027b-475e-9a5c-6c076112b5c3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.169595 Aug 23 08:21:14.243067 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 226/436] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:14 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:14.255102 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-8bfd82fc-b9ff-4f18-b431-8e66f9880b07 req-d4cd8fc7-9785-4057-b80a-73085834f501 service nova] Creating event network-changed:45a86e4c-4b29-4cf5-9d39-a17035e4def7 for instance bc318533-6346-493b-a0b4-c5920b0afefb on hv-cinder-85407 Aug 23 08:21:14.255102 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-8bfd82fc-b9ff-4f18-b431-8e66f9880b07 req-d4cd8fc7-9785-4057-b80a-73085834f501 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040693 Aug 23 08:21:14.255102 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 211/437] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:21:14.921187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:14.921791 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:14.928347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:14.928826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:14.929250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:14.929926 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:14.930371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:14.930783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:15.060323 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:15.068564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:15.070082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:15.071233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-df4501af-7ed7-49bd-b860-8f07e0cec07c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.153848 Aug 23 08:21:15.071787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 227/438] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:14 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:15.199606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:15.200306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:15.206414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:15.206898 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:15.207395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:15.208086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:15.208547 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:15.208973 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:15.272558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:15.273223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:15.279116 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:15.279603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:15.280038 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:15.280734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:15.281187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:15.281611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:15.367818 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:15.376037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-17d9ab16-7d1a-4097-8c86-ca4fb589ef80 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.180672 Aug 23 08:21:15.376980 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 212/439] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:15 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:15.426734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:15.434883 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-185d7f5d-95e6-4850-ab62-9cd9bd564497 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.166248 Aug 23 08:21:15.435458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 228/440] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:15 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:16.095097 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:16.095644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:16.097568 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:16.102386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:16.102868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:16.103338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:16.104024 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:16.104482 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:16.104917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:16.233576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:16.241936 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:16.243487 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:16.244671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d5a31335-9689-49ee-bd79-7aecd8b78233 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.153696 Aug 23 08:21:16.245223 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 213/441] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:16 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:16.396188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:16.396832 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:16.398795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:16.404212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:16.404763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:16.405258 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:16.406007 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:16.406523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:16.407031 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:16.456608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:16.457418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:16.463468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:16.464091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:16.464666 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:16.465468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:16.466029 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:16.466577 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:16.584188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:16.592664 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0646d6de-7365-411f-94c1-fc1da24fb214 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.200392 Aug 23 08:21:16.593234 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 229/442] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:16 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:16.640922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:16.648647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1a44a23d-a702-4d0a-8370-07fb87cfb3b1 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.196117 Aug 23 08:21:16.649308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 214/443] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:16 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:17.268009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:17.268606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:17.270403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=12 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:17.275100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:17.275622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:17.276051 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:17.276772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:17.289133 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:17.289133 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:17.403831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:17.412504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:17.414198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:17.415395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a17f4829-d95b-445d-9f30-a1c143bcca20 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.151253 Aug 23 08:21:17.415984 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 230/444] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:17 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:17.612482 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:17.613098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:17.615004 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=8 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:17.619834 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:17.620321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:17.620760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:17.621449 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:17.621906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:17.622354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:17.669280 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:17.669986 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:17.676053 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:17.676541 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:17.676976 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:17.677667 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:17.678125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:17.678552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:17.796264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:17.804227 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-216e1c05-fd93-4ff2-8d61-2bc843e6c67c tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.195529 Aug 23 08:21:17.804796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 215/445] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:17 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:17.840296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:17.848175 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-890a7b95-b4a8-4fe7-87a0-a7a1bb7be6b8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.182723 Aug 23 08:21:17.848736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 231/446] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:17 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:18.438437 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:18.439004 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:18.445600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:18.446087 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:18.446527 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:18.447295 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:18.447760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:18.448188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:18.573408 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:18.581782 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:18.583335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:18.584498 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ed7b599a-6c0a-45a8-b75d-0ad8c78ac672 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.150115 Aug 23 08:21:18.585056 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 216/447] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:18 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:18.825881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:18.826492 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:18.833125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:18.833632 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:18.834107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:18.834826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:18.835308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:18.835728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:18.868565 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:18.869267 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:18.875426 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:18.875901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:18.876341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:18.877075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:18.877660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:18.878096 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:19.023692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:19.027804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:19.032749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b9dabc5e-11f5-4ce0-8f9f-bfa4f29b38d8 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.210799 Aug 23 08:21:19.033381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 232/448] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:18 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:19.044991 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:19.052657 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0d30e10c-9169-4d96-90b3-a0f0db2dfe90 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.187879 Aug 23 08:21:19.053218 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 217/449] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:18 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:19.607779 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:19.608387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:19.614986 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:19.615472 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:19.615907 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:19.616587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:19.617037 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:19.617481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:19.748833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:19.756818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:19.758315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:19.759504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6bb794aa-b6c6-4c9d-a5ac-cbda29c2ec25 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.155641 Aug 23 08:21:19.760049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 233/450] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:19 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:20.053096 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:20.053743 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:20.059739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:20.060224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:20.060659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:20.061344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:20.061800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:20.062296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:20.073706 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:20.074289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:20.081326 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:20.081817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:20.082253 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:20.082974 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:20.083437 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:20.083899 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:20.264745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:20.269990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:20.273529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ed3fa59f-79b3-4471-b7ff-fcea11cc9f0f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.224285 Aug 23 08:21:20.274109 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 218/451] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:20 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:20.278678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c65a3ac4-8125-467c-8e6a-5f559944d6c8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.208661 Aug 23 08:21:20.291140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 234/452] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:20 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:20.294423 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-d833cb9a-e4d6-4c2c-af0d-f49951ad9bfe req-07882b4a-5c7a-42bf-89fa-33b1c356efa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc318533-6346-493b-a0b4-c5920b0afefb", "name": "network-vif-plugged", "status": "completed", "tag": "45a86e4c-4b29-4cf5-9d39-a17035e4def7"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:20.303908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d833cb9a-e4d6-4c2c-af0d-f49951ad9bfe req-07882b4a-5c7a-42bf-89fa-33b1c356efa6 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:20.304389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d833cb9a-e4d6-4c2c-af0d-f49951ad9bfe req-07882b4a-5c7a-42bf-89fa-33b1c356efa6 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:20.304828 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d833cb9a-e4d6-4c2c-af0d-f49951ad9bfe req-07882b4a-5c7a-42bf-89fa-33b1c356efa6 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:20.308778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:20.316958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-d833cb9a-e4d6-4c2c-af0d-f49951ad9bfe req-07882b4a-5c7a-42bf-89fa-33b1c356efa6 service nova] Creating event network-vif-plugged:45a86e4c-4b29-4cf5-9d39-a17035e4def7 for instance bc318533-6346-493b-a0b4-c5920b0afefb on hv-cinder-85407 Aug 23 08:21:20.322011 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-d833cb9a-e4d6-4c2c-af0d-f49951ad9bfe req-07882b4a-5c7a-42bf-89fa-33b1c356efa6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031822 Aug 23 08:21:20.322587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 219/453] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:21:20.781931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:20.782596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:20.788516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:20.789004 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:20.789441 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:20.790124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:20.791278 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:20.791710 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:20.916770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:20.924793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:20.926282 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:20.928447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-32413f15-5f52-43ca-8b45-ae84d230ca91 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.149397 Aug 23 08:21:20.928447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 235/454] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:20 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:21.296432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:21.297121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:21.299967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:21.301153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:21.303457 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:21.303947 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:21.305037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:21.305755 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:21.307055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:21.307520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:21.308848 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:21.309343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:21.309777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:21.310645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:21.311292 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:21.311876 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:21.510796 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:21.513783 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:21.518705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e37097ae-036d-4bd6-a9b0-d813daea14a5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.222584 Aug 23 08:21:21.519592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 236/455] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:21 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:21.521363 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-423edba6-3f82-45a8-a59a-5d2098570cb1 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.229590 Aug 23 08:21:21.521916 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 220/456] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:21 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:21.950083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:21.950694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:21.956669 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:21.957154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:21.957590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:21.958277 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:21.958752 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:21.959202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:22.084062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:22.092957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:22.094475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:22.095668 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-94ce92e2-ebda-42a8-bd34-3fad65bffb65 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.149975 Aug 23 08:21:22.096264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 237/457] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:21 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:22.539454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:22.540103 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:22.541058 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:22.541804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:22.546231 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:22.546764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:22.547248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:22.547942 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:22.548400 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:22.548516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:22.548824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:22.548931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:22.549368 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:22.550075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:22.550538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:22.550966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:22.738583 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:22.742711 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:22.746435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d2eb0b3b-7731-4577-98fd-5f5780dddda7 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.209137 Aug 23 08:21:22.747028 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 238/458] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:22 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:22.750702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ca5415fe-1ff7-4e8a-97d6-e15281919ead tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.215180 Aug 23 08:21:22.751281 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 221/459] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:22 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:23.117888 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:23.119104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:23.125285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:23.125773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:23.126207 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:23.126919 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:23.127441 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:23.127868 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:23.255968 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:23.264598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:23.266110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:23.267308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-218579d2-e695-4d2f-8bf6-3b3b88c1be24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.153312 Aug 23 08:21:23.267855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 239/460] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:23 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:23.767211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:23.767813 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:23.770525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:23.771167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:23.773732 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:23.774210 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:23.775161 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:23.776037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:23.776484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:23.776906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:23.778371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:23.778930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:23.779414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:23.780112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:23.781939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:23.781939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:24.164212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:24.168681 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:24.172624 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f3b9d50f-4292-4293-b82a-6bdbf3e30779 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.405902 Aug 23 08:21:24.173188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 240/461] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:23 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:21:24.176433 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e5f4973f-013d-4cc8-80ff-5296f53b627e tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1315 microversion: 2.1 time: 0.413198 Aug 23 08:21:24.176986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 222/462] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:23 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:24.289985 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:24.291161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:24.296987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:24.297465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:24.297895 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:24.298575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:24.299048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:24.299473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:24.425366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:24.433955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:24.438201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:24.438201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-207f9819-b64a-4fd7-ad88-d57767b56f43 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.150502 Aug 23 08:21:24.438201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 241/463] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:24 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:25.044334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-757ec08a-e494-4751-bd18-fdfb8f8e6fb9 req-154c2dc5-eca0-4b1d-bbf3-a352ace437b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f551e6-2e0d-4d2c-a539-007f40fc0b2a", "name": "network-vif-plugged", "status": "completed", "tag": "f9684eb6-9cdc-4571-81b6-89a182589779"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:25.053677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-757ec08a-e494-4751-bd18-fdfb8f8e6fb9 req-154c2dc5-eca0-4b1d-bbf3-a352ace437b8 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.060852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-757ec08a-e494-4751-bd18-fdfb8f8e6fb9 req-154c2dc5-eca0-4b1d-bbf3-a352ace437b8 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.060852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-757ec08a-e494-4751-bd18-fdfb8f8e6fb9 req-154c2dc5-eca0-4b1d-bbf3-a352ace437b8 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.066014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-757ec08a-e494-4751-bd18-fdfb8f8e6fb9 req-154c2dc5-eca0-4b1d-bbf3-a352ace437b8 service nova] Creating event network-vif-plugged:f9684eb6-9cdc-4571-81b6-89a182589779 for instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a on hv-cinder-85407 Aug 23 08:21:25.071268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-757ec08a-e494-4751-bd18-fdfb8f8e6fb9 req-154c2dc5-eca0-4b1d-bbf3-a352ace437b8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031225 Aug 23 08:21:25.071894 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 223/464] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:21:25.193933 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:25.194645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:25.198271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:25.199301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:25.201675 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.202216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.202811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.203654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.204317 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.204920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.205980 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.206721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.207407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.208350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.208974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.209843 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.403332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:25.405887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:25.412511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4358f580-9851-4714-b3f1-e959f6c18a16 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.222646 Aug 23 08:21:25.415783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 242/465] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:25 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:25.415898 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3ee2f282-5774-4f8a-b4cd-6114343687e3 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1465 microversion: 2.1 time: 0.220319 Aug 23 08:21:25.415898 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 224/466] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:25 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1465 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:25.462338 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:25.462914 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:25.463153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:25.463633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:25.469278 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.469712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.469830 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.470224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.470339 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.470703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.470922 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.471400 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.471588 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.471825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.472212 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.472634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.500428 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:21:25.604482 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:25.612551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:25.614050 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:25.615221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c50fa34a-58b1-4805-8e60-6785fa586bd5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.157285 Aug 23 08:21:25.615832 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 243/467] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:25 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:25.809234 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-aaebadb5-4976-4270-bdc6-f29172248560 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 204 len: 0 microversion: 2.1 time: 0.350588 Aug 23 08:21:25.809851 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 225/468] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:21:25 2022] DELETE /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 08:21:25.818509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:25.819155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:25.824993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.826725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.826725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.826725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:25.827124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:25.827431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:25.951985 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:25.959531 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-04e7e99a-2f1a-48a0-91ac-dee99e3dff1f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1471 microversion: 2.1 time: 0.145178 Aug 23 08:21:25.960096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 244/469] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:25 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1471 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:26.434844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:26.435574 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:26.441946 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:26.442460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:26.442895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:26.443616 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:26.444134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:26.444559 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:26.571704 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:26.579341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-00bb2dba-a7df-486c-936a-c8509b551b82 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.148721 Aug 23 08:21:26.579905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 226/470] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:26 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:26.638377 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:26.639027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:26.645460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:26.645945 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:26.646385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:26.647121 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:26.647580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:26.648004 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:26.777994 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:26.786198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:26.787754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:26.788917 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-10874180-186d-4c87-8911-d35332f59a9c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.155009 Aug 23 08:21:26.789467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 245/471] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:26 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:26.980440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:26.980964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:26.986918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:26.987425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:26.987855 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:26.988535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:26.988989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:26.989409 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:27.119069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:27.126978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c39809da-069e-4a14-b3cf-5cc9c13fb2af tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1471 microversion: 2.1 time: 0.150377 Aug 23 08:21:27.127546 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 227/472] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:26 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:27.600708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:27.601275 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:27.608071 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:27.608557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:27.608992 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:27.609712 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:27.610169 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:27.610594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:27.740954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:27.749046 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2be2b45c-e525-4987-8c82-1f3a6881bf11 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1317 microversion: 2.1 time: 0.152223 Aug 23 08:21:27.749751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 246/473] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:27 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:27.810876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:27.811509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:27.817906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:27.818384 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:27.818847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:27.819554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:27.820002 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:27.820442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:27.948871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:27.957719 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:27.959371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:27.960522 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6664f0b5-e9c9-484e-aba1-58b90605fcf1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.153607 Aug 23 08:21:27.961068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 228/474] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:27 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:28.148481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:28.149939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:28.155969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:28.156451 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:28.156886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:28.157569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:28.158022 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:28.158474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:28.291166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:28.298853 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-07bcdee7-c557-45a7-91cd-fc22f4b5c376 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1471 microversion: 2.1 time: 0.154497 Aug 23 08:21:28.299444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 247/475] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:28 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:28.769676 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:28.770285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:28.776998 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:28.777480 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:28.777908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:28.778587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:28.779059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:28.779535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:28.903962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:28.911615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-aed194a0-4c9a-4325-98e2-0ff8d9c6e43e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1504 microversion: 2.1 time: 0.145805 Aug 23 08:21:28.912170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 229/476] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:28 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1504 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:28.984442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:28.985053 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:28.991427 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:28.991913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:28.992351 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:28.993661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:28.994078 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:28.994504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:29.131928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:29.140007 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:29.141510 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:29.142690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-781e13ec-7a8b-4009-83a7-3a58e2590597 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.162369 Aug 23 08:21:29.143255 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 248/477] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:28 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:29.320470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:29.320996 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:29.326927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:29.327445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:29.327911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:29.328603 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:29.329056 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:29.329490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:29.460375 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:29.468943 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-cc260bed-2f48-4c70-94bd-e17cf84744c6 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1471 microversion: 2.1 time: 0.152723 Aug 23 08:21:29.469550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 230/478] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:29 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:30.169638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:30.173970 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:30.182247 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:30.182745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:30.183209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:30.183932 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:30.184386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:30.184806 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:30.208013 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:30.344242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:30.352790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:30.354281 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:30.355518 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-56e2d0d8-89f2-48ad-8b73-67bdf4a2754b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1744 microversion: 2.20 time: 0.193694 Aug 23 08:21:30.356064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 249/479] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:30 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:30.491876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:30.492647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:30.499721 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-08e3e036-8088-4b34-8ed7-f2734bcdfbba req-0af02412-da3e-40f7-aaa4-aaee3183bac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc318533-6346-493b-a0b4-c5920b0afefb", "name": "network-vif-deleted", "tag": "45a86e4c-4b29-4cf5-9d39-a17035e4def7"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:30.507927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:30.508742 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:30.509386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:30.510132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:30.510544 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-08e3e036-8088-4b34-8ed7-f2734bcdfbba req-0af02412-da3e-40f7-aaa4-aaee3183bac6 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:30.510673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:30.511109 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:30.511332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-08e3e036-8088-4b34-8ed7-f2734bcdfbba req-0af02412-da3e-40f7-aaa4-aaee3183bac6 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:30.511762 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-08e3e036-8088-4b34-8ed7-f2734bcdfbba req-0af02412-da3e-40f7-aaa4-aaee3183bac6 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:30.541055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-08e3e036-8088-4b34-8ed7-f2734bcdfbba req-0af02412-da3e-40f7-aaa4-aaee3183bac6 service nova] Creating event network-vif-deleted:45a86e4c-4b29-4cf5-9d39-a17035e4def7 for instance bc318533-6346-493b-a0b4-c5920b0afefb on hv-cinder-85407 Aug 23 08:21:30.547921 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-08e3e036-8088-4b34-8ed7-f2734bcdfbba req-0af02412-da3e-40f7-aaa4-aaee3183bac6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055862 Aug 23 08:21:30.549291 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 250/480] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:21:30.598968 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:30.607961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1831cac1-a49c-4750-abc9-540828012671 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1429 microversion: 2.1 time: 0.122008 Aug 23 08:21:30.608694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 231/481] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:30 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:31.379295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:31.380080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:31.387325 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:31.390682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:31.390682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:31.390682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:31.390682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:31.391146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:31.526586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:31.535048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:31.536814 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:31.538109 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3a559490-73c4-4275-af4a-3afc5ede7708 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1744 microversion: 2.20 time: 0.162935 Aug 23 08:21:31.538917 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 251/482] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:31 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:31.629053 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:31.629667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:31.636747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:31.637445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:31.637875 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:31.638585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:31.639241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:31.639662 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:31.673124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:31.673655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:31.674097 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:31.674555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lazy-loading 'fault' on Instance uuid bc318533-6346-493b-a0b4-c5920b0afefb {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:21:31.716066 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe286cbe88934741822be3f74870b302', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8586b18aaa47f598a11b272031217a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:31.723700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-81b5d903-04fe-4d3f-9209-6ef64322db67 tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 200 len: 1305 microversion: 2.1 time: 0.098539 Aug 23 08:21:31.728949 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 232/483] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:31 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:21:32.560925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:32.561523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:32.568158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:32.568634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:32.569059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:32.569731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:32.570175 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:32.571122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:32.704065 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:32.713022 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:32.714585 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:32.715842 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4b622b53-4f8f-425c-bacc-76aa088dbfcc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1744 microversion: 2.20 time: 0.158745 Aug 23 08:21:32.716413 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 252/484] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:32 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:21:32.745119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:32.745706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] [instance: bc318533-6346-493b-a0b4-c5920b0afefb] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:32.751648 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:32.752148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:32.752591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:32.753260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:32.753707 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:32.754124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:32.768249 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] HTTP exception thrown: Instance bc318533-6346-493b-a0b4-c5920b0afefb could not be found. Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Request method failure captured: Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb HTTP/1.1 Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI3p4Xb7TLGzDuWJWnrdlY_arYhGv5BRVhruNf32WdbDgQvCatTDAiaghrvSrWZbL0_-ZzalCgyfeQV6KwsidEZ_6Pxd9UdBV1CwFSdH37lv-ppIh9YgTvuLbHxX_ntlPcSKdI24iXSg84kmH2TFWm-81Wi7d7TFZ5fl-bRtQTNbEoY Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1e8586b18aaa47f598a11b272031217a Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-VolumesNegativeTest-630934448 Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:21:32.769901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1e8586b18aaa47f598a11b272031217a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1e8586b18aaa47f598a11b272031217a", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1e8586b18aaa47f598a11b272031217a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1e8586b18aaa47f598a11b272031217a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-VolumesNegativeTest-630934448 Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1e8586b18aaa47f598a11b272031217a Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-VolumesNegativeTest-630934448 Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-VolumesNegativeTest-630934448-project Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: fe286cbe88934741822be3f74870b302 Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-VolumesNegativeTest-630934448-project Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance bc318533-6346-493b-a0b4-c5920b0afefb could not be found. Aug 23 08:21:32.771584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'bc318533-6346-493b-a0b4-c5920b0afefb'} Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc318533-6346-493b-a0b4-c5920b0afefb could not be found. Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:21:32.772529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc318533-6346-493b-a0b4-c5920b0afefb could not be found. Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc318533-6346-493b-a0b4-c5920b0afefb could not be found. Aug 23 08:21:32.774626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:21:32.775956 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] Returning 404 to user: Instance bc318533-6346-493b-a0b4-c5920b0afefb could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:21:32.775956 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d8ec09a9-4a5b-4fe1-97bd-79a7e0b9124f tempest-VolumesNegativeTest-630934448 tempest-VolumesNegativeTest-630934448-project] 10.222.0.58 "GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb" status: 404 len: 111 microversion: 2.1 time: 0.030051 Aug 23 08:21:32.775956 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 233/485] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:21:32 2022] GET /compute/v2.1/servers/bc318533-6346-493b-a0b4-c5920b0afefb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 08:21:33.738914 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:33.739645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:33.745972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:33.747100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:33.747577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:33.748016 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:33.748714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:33.749212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:33.749639 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:33.886397 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:33.894776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:33.896360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:33.897555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d97e2eff-5824-4724-9c48-912d44c9ffc0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1744 microversion: 2.20 time: 0.162786 Aug 23 08:21:33.898113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 253/486] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:33 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:34.922106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:34.922777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:34.931275 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:34.935224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:34.935224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:34.935224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:34.935224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:34.936194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:35.012213 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-51c8ac4c-eef9-48da-b4a0-77f9b1eb364d req-192a1c5e-25f1-4583-8eb9-1e9069d435c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895b9968-c8a0-4035-82f3-15a6726d65ed", "name": "network-vif-plugged", "status": "completed", "tag": "c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:35.024558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-51c8ac4c-eef9-48da-b4a0-77f9b1eb364d req-192a1c5e-25f1-4583-8eb9-1e9069d435c4 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:35.024558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-51c8ac4c-eef9-48da-b4a0-77f9b1eb364d req-192a1c5e-25f1-4583-8eb9-1e9069d435c4 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:35.025255 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-51c8ac4c-eef9-48da-b4a0-77f9b1eb364d req-192a1c5e-25f1-4583-8eb9-1e9069d435c4 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:35.044786 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-51c8ac4c-eef9-48da-b4a0-77f9b1eb364d req-192a1c5e-25f1-4583-8eb9-1e9069d435c4 service nova] Creating event network-vif-plugged:c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097 for instance 895b9968-c8a0-4035-82f3-15a6726d65ed on hv-cinder-85407 Aug 23 08:21:35.050744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-51c8ac4c-eef9-48da-b4a0-77f9b1eb364d req-192a1c5e-25f1-4583-8eb9-1e9069d435c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043658 Aug 23 08:21:35.051711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 254/487] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:21:35.106270 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:35.119705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:35.121337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:35.122606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-fde49036-d588-4541-9d53-b37339806e93 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1744 microversion: 2.20 time: 0.204732 Aug 23 08:21:35.123233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 234/488] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:34 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:36.147754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:36.153691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:36.160060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:36.160537 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:36.160963 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:36.161646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:36.162256 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:36.162672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:36.309394 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:36.318566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:36.320286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:36.321494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4a545a2c-449f-4bd5-b31f-7b4312ad4929 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1744 microversion: 2.20 time: 0.179907 Aug 23 08:21:36.322060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 255/489] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:36 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:37.346245 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:37.347420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:37.353700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:37.355807 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:37.356458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:37.357137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:37.358477 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:37.359511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:37.360395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:37.557000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:37.563584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:21:37.577020 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:37.578750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:37.579989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9d1d5e80-f4ee-4d80-bc48-26aac2f59c1b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.238113 Aug 23 08:21:37.580449 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 235/490] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:37 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:38.605875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:38.606564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:38.614193 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:38.615081 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:38.615713 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:38.616576 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:38.617233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:38.617849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:38.964363 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:39.007362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:39.009800 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:39.011272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7cb5318a-3ab8-4371-a18f-ce8b6799cdeb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.409172 Aug 23 08:21:39.015465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 256/491] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:38 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:40.038414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:40.041456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:40.064921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:40.066039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:40.066818 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:40.067849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:40.068565 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:40.069226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:40.412299 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:40.427120 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:40.431115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:40.432657 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f4fb7f20-c06a-4a9f-8176-d05fb371f66f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.398352 Aug 23 08:21:40.435994 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 236/492] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:40 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:41.457907 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:41.458720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:41.465717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:41.615959 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:41.615959 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:41.615959 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:41.615959 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:41.618153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:41.648229 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:41.657321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:41.659123 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:41.663283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c54b8478-1037-4459-b0b3-83582a3894e3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.206577 Aug 23 08:21:41.663283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 257/493] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:41 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:42.714912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:42.714912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:42.714912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:42.714912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:42.715700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:42.715700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:42.715700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:42.715700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:42.884030 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:42.894054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:42.900983 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:42.903906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2af9883b-3ac5-431e-92f2-ff6902d8bf02 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.209826 Aug 23 08:21:42.905698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 237/494] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:42 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:43.930132 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:43.930762 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:43.950560 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:43.959783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:43.960691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:43.961522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:43.962065 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:43.962589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:44.211741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:44.223151 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:44.224782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:44.226629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8792e28b-6aa4-43b3-99c0-b1be8dc7e613 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.301189 Aug 23 08:21:44.244644 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 258/495] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:43 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:45.252630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:45.254686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:45.263851 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:45.264652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:45.265176 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:45.266112 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:45.266797 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:45.267475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:45.446611 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:45.459345 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:45.461363 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:45.462726 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e1c9abf5-0295-4ca7-bddb-59371733bee8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.216233 Aug 23 08:21:45.463572 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 238/496] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:45 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:46.488843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:46.489446 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:46.499643 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:46.507012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:46.507012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:46.507012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:46.507012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:46.507418 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:46.723348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:46.732124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:46.745397 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:46.752769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4649b726-6a41-4afd-b7ab-7747627582c9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.267798 Aug 23 08:21:46.753352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 259/497] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:46 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:47.782834 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:47.787163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:47.795530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:47.796395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:47.797318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:47.798275 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:47.799301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:47.800254 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:48.095714 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:48.123731 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:48.129301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:48.129301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-74e377e0-f35d-41a6-a7d7-7544e096eccb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.352079 Aug 23 08:21:48.129301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 239/498] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:47 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:49.153866 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:49.155236 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:49.167033 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:49.170197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:49.170197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:49.170197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:49.170197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:49.170551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:49.439264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:49.452936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:49.454833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:49.457979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-17d414d3-b856-4aa0-b86c-839a9f33f1d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.308029 Aug 23 08:21:49.460400 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 260/499] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:49 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:50.486014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:50.489386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:50.497659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:50.498374 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:50.498992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:50.499695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:50.500154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:50.500578 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:50.840146 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:50.858458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:50.860744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:50.862374 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-469fcc5a-b48d-4b39-967d-44fab78abcf0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.384326 Aug 23 08:21:50.880368 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 240/500] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:50 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:51.888501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:51.889185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:51.895635 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:51.896155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:51.896616 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:51.898051 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:51.898672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:51.899122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:52.194451 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:52.194451 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:52.195683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:52.195683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ec101e42-2da8-4e49-90bb-8560d36aaabb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.284548 Aug 23 08:21:52.195683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 261/501] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:51 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:53.193781 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:53.194383 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:53.200405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:53.200884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:53.201313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:53.202275 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:53.202725 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:53.203172 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:53.357867 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:53.362195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:53.364921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:53.366141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b0961960-b722-42cf-841c-7c03d56d7ebc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.176520 Aug 23 08:21:53.366688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 241/502] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:53 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:54.392628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:54.394954 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:54.404557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:54.406798 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:54.408268 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:54.409823 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:54.410475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:54.411097 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:54.649231 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:54.658232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:54.659783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:54.661141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5b281f3f-0b15-4421-aeb4-20b1a93fbe51 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1739 microversion: 2.20 time: 0.273025 Aug 23 08:21:54.662225 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 262/503] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:54 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:55.688167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:55.688710 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:55.692668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4327cdd-a900-4dce-a802-1ed69852c379", "device": "/dev/sdb"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:55.696243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:55.713271 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:55.713764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:55.714197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:55.714914 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:55.715416 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:55.715835 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:55.720168 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:55.720660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:55.721091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:55.721795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:55.722253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:55.722680 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:55.947995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:55.956809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:55.974134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:55.976307 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cc8c41be-3806-4a9f-aa97-48baeb7a3f24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1721 microversion: 2.20 time: 0.291958 Aug 23 08:21:55.977487 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 263/504] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:55 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1721 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:21:57.000855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:57.001548 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:57.008451 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:57.017131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:57.017131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:57.017131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:57.017131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:57.017741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:57.303605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f1896837-db93-443e-beb6-fe1ce80c5df0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "POST /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.631356 Aug 23 08:21:57.304428 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 242/505] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:21:55 2022] POST /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a/os-volume_attachments => generated 194 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:21:57.310129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-e859100b-3d5d-40b8-81a8-d4bde991b700 req-633b201a-1407-4ed3-8cc2-04b9dd8b77df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895b9968-c8a0-4035-82f3-15a6726d65ed", "name": "network-vif-unplugged", "status": "completed", "tag": "c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:57.335648 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-e859100b-3d5d-40b8-81a8-d4bde991b700 req-633b201a-1407-4ed3-8cc2-04b9dd8b77df service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:57.336531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-e859100b-3d5d-40b8-81a8-d4bde991b700 req-633b201a-1407-4ed3-8cc2-04b9dd8b77df service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:57.337186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-e859100b-3d5d-40b8-81a8-d4bde991b700 req-633b201a-1407-4ed3-8cc2-04b9dd8b77df service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:57.357090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:57.358286 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-e859100b-3d5d-40b8-81a8-d4bde991b700 req-633b201a-1407-4ed3-8cc2-04b9dd8b77df service nova] Creating event network-vif-unplugged:c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097 for instance 895b9968-c8a0-4035-82f3-15a6726d65ed on hv-cinder-85407 Aug 23 08:21:57.369791 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-e859100b-3d5d-40b8-81a8-d4bde991b700 req-633b201a-1407-4ed3-8cc2-04b9dd8b77df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060678 Aug 23 08:21:57.371071 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 243/506] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:21:57.377510 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:57.381166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:57.381166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4bc10a9a-2db0-4b82-bd17-7a7f0d02b745 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1721 microversion: 2.20 time: 0.383467 Aug 23 08:21:57.400227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 264/507] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:56 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1721 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:21:58.415476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:21:58.422185 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:58.423984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:58.424476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:58.425124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:58.426170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:58.426637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:58.427267 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:58.637584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:58.647037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:58.648649 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:21:58.650012 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b19e43eb-b7b0-4e1f-b839-e5a1ed46a7ef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1724 microversion: 2.20 time: 0.245768 Aug 23 08:21:58.650565 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 244/508] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:21:58 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:21:58.677331 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49d849da-4af2-4fe1-9884-f5bee871fd66"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:21:58.680556 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:21:58.687882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:58.688636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:58.689285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:58.689989 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:21:58.690699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:21:58.691195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:21:59.479999 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:00.022184 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5b881d84-d7c4-42ad-b2c9-8923b9677fcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.351197 Aug 23 08:22:00.022898 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 265/509] 10.222.0.58 () {62 vars in 1364 bytes} [Tue Aug 23 08:21:58 2022] POST /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments => generated 188 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:22:00.149859 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:22:00.150510 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:00.158576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:00.159229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:00.159812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:00.160772 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:00.161392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:00.161938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:00.208829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121383) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 08:22:00.800920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-064bbb04-aa36-4153-bc39-487ff4680c1a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/action" status: 202 len: 0 microversion: 2.20 time: 0.653792 Aug 23 08:22:00.801463 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 245/510] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Aug 23 08:22:00 2022] POST /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:22:00.809754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:00.810373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:00.824661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:00.825151 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:00.825655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:00.826366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:00.826824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:00.827275 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:00.978003 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:00.991227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:00.993005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:00.994212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-726e116f-87e6-4b00-afb3-c0fea186a6bd tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1750 microversion: 2.20 time: 0.188328 Aug 23 08:22:00.994975 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 266/511] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:00 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:02.018552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:02.019847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:02.027502 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:02.032906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:02.032906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:02.032906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:02.032906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:02.033248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:02.176673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:02.187081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:02.188410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:02.189502 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4ad4a6cb-956c-4419-b490-27f4c3283f55 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1750 microversion: 2.20 time: 0.175763 Aug 23 08:22:02.191489 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 246/512] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:02 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:03.215980 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:03.216592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:03.224947 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:03.225441 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:03.225881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:03.226586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:03.227069 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:03.227497 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:03.363926 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:03.373228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:03.374725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:03.375903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cbc37d58-fa0f-4f27-819b-1fd529d7efcf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1752 microversion: 2.20 time: 0.164232 Aug 23 08:22:03.379343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 267/513] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:03 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:04.402390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:04.403031 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:04.409400 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:04.409873 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:04.410306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:04.411009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:04.411457 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:04.412534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:04.542705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:04.552197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:04.554382 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:04.555567 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-72ca7f74-f0fe-47e3-a9b6-6749d72cf024 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1752 microversion: 2.20 time: 0.157032 Aug 23 08:22:04.556638 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 247/514] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:04 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:04.797039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-746b8e69-4d5b-4295-9553-704c503d18bd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Action: 'create', calling method: .version_select at 0x7fa61a04fa60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1418307142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAf0uHWR/BFR9qyuM0wROySPFiiZueNgx3YqPMIn575ri2B9IHZ9rIuDgda7UCoeZMqPUDczbJuBUc+/a+PMwZF3pXsbFiN0rJWN0vt15dTCJYW/AsiRxg4ivdStB3a50w=="}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:22:04.821753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-746b8e69-4d5b-4295-9553-704c503d18bd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Getting quotas for project d6382332279746739a247cfb7085cebf. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:22:04.825642 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-746b8e69-4d5b-4295-9553-704c503d18bd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Getting quotas for user 6a05807b7fd04df38e3d1fa455ec2384 and project d6382332279746739a247cfb7085cebf. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:22:04.963133 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-746b8e69-4d5b-4295-9553-704c503d18bd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.169788 Aug 23 08:22:04.963734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 268/515] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:22:04 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:22:05.012175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-805075767", "imageRef": "2f26bc0f-ac77-4213-a5d7-4590cc6c2afd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1418307142", "networks": [{"uuid": "729f0607-54e8-4e84-b1ae-0a6e0de4978c"}]}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:22:05.065543 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] validate_networks() for [('729f0607-54e8-4e84-b1ae-0a6e0de4978c', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:22:05.432895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:22:05.433453 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:22:05.433786 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:22:05.434199 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:22:05.434613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:22:05.443745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:05.444229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:05.449247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:05.449247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:05.449247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:05.449247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:05.462783 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Getting quotas for project d6382332279746739a247cfb7085cebf. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:22:05.466758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Getting quotas for user 6a05807b7fd04df38e3d1fa455ec2384 and project d6382332279746739a247cfb7085cebf. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:22:05.478496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:22:05.480731 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2f26bc0f-ac77-4213-a5d7-4590cc6c2afd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:22:05.578389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:05.579084 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:05.580945 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:05.585765 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:05.586249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:05.586688 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:05.587430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:05.587886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:05.588316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:05.634066 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f9224495-5370-4301-bdfb-bd40e18dc342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625755 Aug 23 08:22:05.635796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 248/516] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:22:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:22:05.649610 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c70f183f-6ccb-4d3e-940f-cb7651be68fe tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:05.650670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c70f183f-6ccb-4d3e-940f-cb7651be68fe tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:05.716118 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c70f183f-6ccb-4d3e-940f-cb7651be68fe tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:05.723190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c70f183f-6ccb-4d3e-940f-cb7651be68fe tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1258 microversion: 2.1 time: 0.081317 Aug 23 08:22:05.735992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 249/517] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:05 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1258 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:05.751462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:05.766122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:05.767739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:05.769554 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3dff9fae-3408-49b9-ae4a-19a6f7bbb8ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1752 microversion: 2.20 time: 0.195250 Aug 23 08:22:05.770422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 269/518] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:05 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1752 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:22:06.745256 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-41a1b64a-603a-4ff8-b477-52b24eebf567 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:06.745872 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-41a1b64a-603a-4ff8-b477-52b24eebf567 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:06.792564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:06.793176 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:06.801558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:06.802061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:06.803032 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:06.803729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:06.804183 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:06.804602 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:06.809365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-41a1b64a-603a-4ff8-b477-52b24eebf567 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:06.819882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-41a1b64a-603a-4ff8-b477-52b24eebf567 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1258 microversion: 2.1 time: 0.078381 Aug 23 08:22:06.831935 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 250/519] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:06 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:06.937709 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:06.947323 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:06.948828 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:06.949979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-36e0baae-e2c7-4d55-9a32-504642bda60a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1752 microversion: 2.20 time: 0.161624 Aug 23 08:22:06.950530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 270/520] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:06 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:22:07.841417 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:07.841953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:07.849573 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:07.850071 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:07.850508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:07.851271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:07.851729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:07.852157 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:07.911245 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:07.919469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7854a209-72f3-42c8-86f6-c1a258f9bb1d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1254 microversion: 2.1 time: 0.081984 Aug 23 08:22:07.920041 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 251/521] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:07 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1254 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:07.973306 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:07.973864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:07.980721 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:07.981203 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:07.981638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:07.982323 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:07.982775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:07.983230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:08.113391 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:08.121993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:08.123523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:08.124654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e19c40d0-5c83-4053-afca-9defebc685ad tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.155407 Aug 23 08:22:08.125198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 271/522] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:07 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:08.941571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:08.942186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:08.948790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:08.949273 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:08.949711 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:08.950402 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:08.950865 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:08.951316 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:09.010924 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:09.018581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b2ec38f5-1323-4f53-b0b6-426ddb61103e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1254 microversion: 2.1 time: 0.081292 Aug 23 08:22:09.019170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 252/523] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:08 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1254 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:09.147989 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:09.148599 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:09.154967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:09.155460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:09.155897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:09.156587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:09.157060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:09.157472 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:09.284639 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:09.293321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:09.294827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:09.296034 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-70b22d00-5fe9-4043-bb26-a384656129ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.152488 Aug 23 08:22:09.296594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 272/524] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:09 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:10.039460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:10.040062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:10.042353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:22:10.043472 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Tue Aug 23 08:22:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 (ip 10.222.0.58) !!! Aug 23 08:22:10.048022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:10.053555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:10.053555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:10.053555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:10.053860 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:10.054571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:10.075734 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:10.117479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:10.125110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c6dcb173-c79b-4ce6-85c1-3a394cc01821 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1254 microversion: 2.1 time: 0.089517 Aug 23 08:22:10.125673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 253/525] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:10 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1254 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:10.420801 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:10.425137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:10.427659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:10.428143 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:10.429107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:10.429795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:10.430250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:10.430675 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:10.555799 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:10.564289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:10.566071 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:10.567288 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-67ce80d9-22d3-4f6a-8400-af9b03b4500b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.252234 Aug 23 08:22:10.567845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 273/526] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:10 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:11.145896 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:11.146500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:11.149844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:11.154843 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:11.155368 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:11.155807 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:11.156505 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:11.156963 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:11.157375 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:11.219658 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:11.228052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f2f43c8f-f7de-4d39-8610-2bb0e270357c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1310 microversion: 2.1 time: 0.085631 Aug 23 08:22:11.228624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 254/527] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:11 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:11.592113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:11.592850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:11.599558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:11.601587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:11.601587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:11.601587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:11.602051 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:11.602494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:11.743383 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:11.752649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:11.754739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:11.756046 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c2c30281-588e-43aa-88fe-d844f9a636f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.168120 Aug 23 08:22:11.757553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 274/528] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:11 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:12.252190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:12.253597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:12.261656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:12.262131 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:12.262559 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:12.263417 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:12.263866 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:12.264284 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:12.354600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:12.362310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c4bfa891-a223-4cb8-8927-c7ebe68cd200 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1316 microversion: 2.1 time: 0.116075 Aug 23 08:22:12.362876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 255/529] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:12 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1316 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:12.780014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:12.780711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:12.788395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:12.788887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:12.789321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:12.790028 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:12.790480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:12.791161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:12.955766 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:12.972284 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:12.975670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:12.977799 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ff7e7d41-d101-4b05-b723-c24ee40a0906 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.201831 Aug 23 08:22:12.997322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 275/530] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:12 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:13.384088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:13.384729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:13.392509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:13.392999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:13.393439 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:13.394134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:13.394775 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:13.395244 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:13.522820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:13.530458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9f6620ea-1108-4d01-b6c3-00abc146eb6c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.150830 Aug 23 08:22:13.531131 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 256/531] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:13 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:14.000524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:14.001166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:14.007595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:14.008076 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:14.008516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:14.009195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:14.009649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:14.010068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:14.136775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:14.145295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:14.146787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:14.148458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2c85130a-c0c1-424a-a9bd-b750c3dccb05 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.151870 Aug 23 08:22:14.149008 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 276/532] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:13 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:14.551287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:14.551902 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:14.558507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:14.559026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:14.559469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:14.560151 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:14.560606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:14.561026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:14.689746 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:14.698124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5ffa3bb8-c92d-465d-98e0-9265b8c203b9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.150761 Aug 23 08:22:14.698682 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 257/533] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:14 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:15.171707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:15.172311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:15.174156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=4 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:15.179874 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:15.180350 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:15.180777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:15.181462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:15.181908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:15.182321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:15.309503 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:15.318366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:15.319901 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:15.321036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c8671d8f-8294-476d-b19f-b7854129645a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.153348 Aug 23 08:22:15.321653 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 277/534] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:15 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:15.719374 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:15.719991 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:15.721810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:15.727753 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:15.728240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:15.728684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:15.729378 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:15.729834 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:15.730264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:15.861861 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:15.869467 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-372093c2-4dd0-4bda-afec-a9338c854d0c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.153960 Aug 23 08:22:15.870029 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 258/535] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:15 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:16.344033 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:16.344644 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:16.351339 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:16.351826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:16.354072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:16.354072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:16.354072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:16.354072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:16.494485 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:16.510130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:16.511983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:16.513368 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d033fc93-22b2-4b03-a2a2-138e76fb3532 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.173280 Aug 23 08:22:16.513918 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 278/536] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:16 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:16.889822 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:16.890435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:16.892764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=10 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:16.897575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:16.898072 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:16.898507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:16.899258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:16.899705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:16.900131 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:17.033250 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:17.043354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d8beae95-8b75-423b-af7a-fc8e0b48d94b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.157351 Aug 23 08:22:17.043990 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 259/537] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:16 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:17.536361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:17.537098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:17.544134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:17.544616 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:17.545058 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:17.545767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:17.546219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:17.546672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:17.683709 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:17.692790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:17.694394 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:17.696179 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-00be86c1-3394-4cf7-89fd-834ebdc5f14f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.163695 Aug 23 08:22:17.696735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 279/538] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:17 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:18.064219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:18.065700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:18.072832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:18.073333 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:18.073830 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:18.074475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:18.074935 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:18.075384 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:18.211962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:18.219551 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b32a7a63-3d27-4d9b-bbe9-0a427e5b370f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.159339 Aug 23 08:22:18.220108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 260/539] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:18 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:18.720836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:18.721608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:18.730073 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:18.730852 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:18.731331 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:18.732042 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:18.732504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:18.732932 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:18.882661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:18.891829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:18.893372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:18.894541 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-de7a567c-b5b0-4821-9183-c26996880b7a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.177701 Aug 23 08:22:18.895125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 280/540] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:18 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:19.240708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:19.241311 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:19.247831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:19.248319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:19.248756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:19.249449 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:19.249931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:19.250358 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:19.376879 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:19.384710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-acae778b-d978-49f6-a954-29743a4f1646 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.147860 Aug 23 08:22:19.385310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 261/541] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:19 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:19.919501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:19.919501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:19.925913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:19.926472 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:19.927001 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:19.927765 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:19.928303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:19.928788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:20.069339 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:20.078923 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:20.080534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:20.081767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7550431e-d6a3-42a8-8108-b9c513214941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.167756 Aug 23 08:22:20.082410 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 281/542] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:19 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:20.406176 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:20.406744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:20.413125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:20.414127 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:20.414568 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:20.415286 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:20.415745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:20.416175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:20.547772 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:20.556479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2cfca9ec-66e3-4b54-80d7-c41da68d7fa7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.154086 Aug 23 08:22:20.558858 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 262/543] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:20 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:21.106098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:21.107113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:21.113799 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:21.114378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:21.114879 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:21.115694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:21.116209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:21.116694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:21.144448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:21.262458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:21.271106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:21.272619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:21.274384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9bc238a3-a746-470e-bd5f-79a810b5c551 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.172263 Aug 23 08:22:21.274928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 282/544] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:21 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:21.580220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:21.580881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:21.588132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:21.588619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:21.589054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:21.589743 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:21.590219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:21.590625 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:21.714367 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:21.722162 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1a787948-4664-4161-9ed6-ee2033735e4b tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.145800 Aug 23 08:22:21.722969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 263/545] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:21 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:22.297980 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:22.298783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:22.306633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:22.307519 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:22.308192 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:22.309142 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:22.309811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:22.310450 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:22.460171 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:22.469651 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:22.471186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:22.472426 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ba1e950e-48ae-422f-874f-edbf0748632e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.178890 Aug 23 08:22:22.473320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 283/546] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:22 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:22.746342 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:22.747152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:22.753738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:22.754225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:22.754662 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:22.755399 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:22.756034 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:22.756620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:22.894150 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:22.901801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-05becfde-f4c7-4803-abf9-7dd9c87cc80c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.161155 Aug 23 08:22:22.902341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 264/547] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:22 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:23.496860 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:23.497505 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:23.504647 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:23.505152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:23.505794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:23.506493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:23.507470 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:23.507920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:23.651301 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:23.660156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:23.661665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:23.662862 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d138ee22-494d-4ea8-aa8b-73f992f7a6a9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.170201 Aug 23 08:22:23.663485 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 284/548] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:23 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:23.923208 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:23.923851 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:23.930736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:23.936729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:23.936729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:23.936729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:23.936729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:23.937686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:24.064233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:24.072710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e3a6adae-2d53-449f-9fbd-d7e2c1adba56 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.153537 Aug 23 08:22:24.073282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 265/549] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:23 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:24.685796 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:24.686514 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:24.694138 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:24.694722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:24.695325 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:24.696098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:24.696627 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:24.697122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:24.827670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:24.836728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:24.839453 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:24.839453 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-74435980-5d2a-40c1-9278-a71fd71331e0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.157574 Aug 23 08:22:24.839924 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 285/550] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:24 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:25.093529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:25.094143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:25.101346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:25.101826 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:25.102261 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:25.102966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:25.103419 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:25.103840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:25.236813 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:25.253321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-cdf4404a-69b0-460a-86f6-53ec1984fa16 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.155872 Aug 23 08:22:25.253321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 266/551] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:25 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:25.861648 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:25.862286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:25.868888 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:25.869378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:25.869816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:25.870513 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:25.870984 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:25.871414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:26.219701 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:26.228285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:26.229845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:26.231038 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e201cea3-bc9d-45df-8018-2b8c625b4919 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.373280 Aug 23 08:22:26.231613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 286/552] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:25 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:22:26.266697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:26.270871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:26.281615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:26.282355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:26.282978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:26.284022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:26.284393 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:26.284853 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:26.419811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:26.427553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2a588c4d-1a21-4816-935e-869d0412e33c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.165843 Aug 23 08:22:26.428185 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 267/553] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:26 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:27.258162 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:27.258767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:27.265158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:27.265636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:27.266060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:27.266745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:27.267225 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:27.267642 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:27.405792 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:27.414660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:27.416190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:27.417344 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a2f15f05-34e1-4df5-8480-14ba7f9b3a18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.163593 Aug 23 08:22:27.417894 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 287/554] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:27 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:27.450382 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:27.450992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:27.458233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:27.459081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:27.459320 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:27.460718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:27.461193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:27.461680 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:27.602036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:27.609920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7feabeb0-4d9a-4e99-9c57-34fb17db8f71 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.163738 Aug 23 08:22:27.610494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 268/555] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:27 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:28.440761 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:28.441466 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:28.448123 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:28.448608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:28.449036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:28.449759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:28.450171 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:28.450590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:28.589828 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:28.598315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:28.599863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:28.601036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0443371c-6a7f-42c4-9a0f-2b0147168797 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.164402 Aug 23 08:22:28.601593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 288/556] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:28 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:28.635641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:28.636394 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:28.642369 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:28.642854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:28.643323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:28.644005 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:28.644455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:28.644876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:28.784180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:28.792125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-be3ba626-e29f-4215-8b71-4ee54666be8d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.164626 Aug 23 08:22:28.792694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 269/557] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:28 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:29.624635 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:29.625215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:29.632199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:29.632679 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:29.633111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:29.633805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:29.634255 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:29.634677 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:29.770203 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:29.779787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:29.781309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:29.782478 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9b7c5025-6786-45a5-a27b-621ac8f04946 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.162079 Aug 23 08:22:29.783061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 289/558] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:29 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:29.813275 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:29.813884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:29.820939 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:29.821418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:29.821849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:29.822524 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:29.823001 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:29.823429 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:29.827313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:29.951715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:29.959236 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-84ac9092-7509-445f-8001-8ce7a8918278 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.149837 Aug 23 08:22:29.959796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 270/559] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:29 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:30.761187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:30.761706 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:30.768031 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:30.768505 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:30.768930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:30.769604 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:30.770049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:30.770462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:30.805915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:30.806542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:30.812603 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:30.813089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:30.813527 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:30.814223 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:30.814683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:30.815388 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:30.893603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lazy-loading 'services' on Instance uuid 96f551e6-2e0d-4d2c-a539-007f40fc0b2a {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:22:30.944631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:30.953476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:30.955035 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:30.956490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-204c57ab-68b6-4fc6-8e1b-a023da422c23 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.155175 Aug 23 08:22:30.957173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 271/560] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:30 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:22:30.980671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:30.981353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:30.987332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:30.987822 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:30.988259 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:30.989015 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:30.989420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:30.989844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:31.119593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:31.127329 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9745eef3-c830-472d-99c1-8575b038c955 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.151331 Aug 23 08:22:31.127894 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 272/561] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:30 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:31.222739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-59abc835-f24b-4474-a90d-484e3958cbeb tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a/os-volume_attachments/a4327cdd-a900-4dce-a802-1ed69852c379" status: 202 len: 0 microversion: 2.1 time: 0.465253 Aug 23 08:22:31.223349 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 290/562] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:22:30 2022] DELETE /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a/os-volume_attachments/a4327cdd-a900-4dce-a802-1ed69852c379 => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:22:31.980445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:31.981049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:31.987474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:31.987962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:31.988397 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:31.989123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:31.989581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:31.990006 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:32.129148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:32.138481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:32.140175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:32.141364 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3edb7b9e-3077-4249-b3d0-ee2c4eee58bb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.165434 Aug 23 08:22:32.141930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 273/563] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:31 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:32.149027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:32.156511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:32.160055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:32.160539 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:32.160979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:32.161717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:32.162130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:32.162553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:32.312740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:32.321506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-17ac4497-5de5-4d18-ba2f-2d2076a55a37 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.177212 Aug 23 08:22:32.322068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 291/564] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:32 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:33.165985 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:33.166864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:33.174003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:33.174615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:33.175305 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:33.176347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:33.177089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:33.177808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:33.315914 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:33.325292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:33.326813 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:33.327999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ef8eeedd-53ee-42ea-9ad5-9ab037c03b1f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.166860 Aug 23 08:22:33.328560 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 274/565] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:33 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:33.341580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:33.342225 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:33.349034 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:33.355824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:33.355824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:33.355824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:33.355824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:33.357056 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:33.490154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:33.498557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1d71be52-2df0-493a-9dc7-0c61cee2f798 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.160810 Aug 23 08:22:33.500036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 292/566] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:33 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:34.350751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:34.351724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:34.358185 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:34.358665 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:34.359144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:34.359831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:34.360289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:34.360714 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:34.502539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:34.511104 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:34.512608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:34.513857 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4353b7db-7ad5-490b-9b14-843584901687 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.167074 Aug 23 08:22:34.514453 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 275/567] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:34 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:34.524607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:34.527138 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:34.534157 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:34.534726 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:34.535275 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:34.536039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:34.536598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:34.537088 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:34.667791 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:34.677282 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7f9bd473-0e2f-4895-a05f-f605905fd269 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.156822 Aug 23 08:22:34.678734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 293/568] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:34 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:35.538697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:35.539354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:35.546371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:35.547108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:35.547591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:35.548315 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:35.548800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:35.549225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:35.686701 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:35.699951 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:35.701124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:35.701855 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:35.702857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:35.703067 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-003fe865-f2e1-491c-9e79-e61666ba890a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.168130 Aug 23 08:22:35.703554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 276/569] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:35 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:35.710359 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:35.711400 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:35.712062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:35.713692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:35.714370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:35.715054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:35.850151 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:35.857889 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-624b8b91-341a-4c5e-aa08-c859e232ba15 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.162399 Aug 23 08:22:35.858454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 294/570] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:35 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:36.725673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:36.726316 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:36.733226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:36.733712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:36.734155 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:36.734852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:36.735335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:36.735781 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:36.877318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:36.878205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:36.879722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:36.886739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:36.887251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:36.887700 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:36.888378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:36.888825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:36.889319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:36.890021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:36.891957 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:36.893372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9980547a-790a-49c8-9e78-7561a8b145aa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.171616 Aug 23 08:22:36.894122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 277/571] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:36 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:37.030438 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:37.037931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a8caeec1-b57b-4305-a510-bfd52385b5e6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.164299 Aug 23 08:22:37.038489 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 295/572] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:36 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:37.917535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:37.918143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:37.925092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:37.926104 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:37.926104 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:37.926761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:37.927257 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:37.927691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:38.060076 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:38.061685 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:38.068732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=54 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:38.070449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:38.071272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:38.072392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:38.073272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:38.073893 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:38.074315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:38.094206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:38.103122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:38.104837 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:38.106121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-81f449bb-eec5-4f4c-be0c-345db166beb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.193330 Aug 23 08:22:38.106687 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 278/573] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:37 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:38.218035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:38.229153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-567e7d7f-1f6a-4a09-a7a5-57f82eb52e3e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.171999 Aug 23 08:22:38.230580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 296/574] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:38 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:39.129455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:39.130041 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:39.137045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:39.137522 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:39.137967 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:39.138642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:39.139123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:39.139542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:39.250136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:39.250770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:39.257435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:39.257951 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:39.258409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:39.259113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:39.259613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:39.260041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:39.270019 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:39.280086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:39.282181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:39.283713 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-981d9189-ba28-4f40-bb36-828f3fa2ecaa tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.158333 Aug 23 08:22:39.285147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 279/575] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:39 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:39.395150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:39.405056 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0daa937d-5c2a-4031-8557-c4851afee342 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.158697 Aug 23 08:22:39.405752 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 297/576] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:39 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:40.310344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:40.311035 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:40.323100 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:40.323739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:40.324505 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:40.325504 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:40.326123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:40.326833 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:40.426371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:40.427127 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:40.434902 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:40.435885 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:40.436534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:40.437473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:40.437998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:40.438502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:40.461239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:40.468235 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:40.478314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:40.480279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:40.481744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b93dc666-16ed-43be-8607-595202eb2dc8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.176887 Aug 23 08:22:40.482832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 280/577] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:40 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:40.577317 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:40.585842 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2551f17d-2b43-4aeb-892a-d3909b623fb2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.163892 Aug 23 08:22:40.586413 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 298/578] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:40 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:41.505721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:41.507273 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:41.515327 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:41.516178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:41.519479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:41.520371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:41.520910 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:41.521429 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:41.607061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:41.608444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:41.621597 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:41.622491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:41.623308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:41.624243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:41.624885 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:41.625507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:41.676409 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:41.685677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:41.687293 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:41.688448 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-38ee24f6-7531-463f-84a5-a1fc1076e8bf tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.186855 Aug 23 08:22:41.689251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 281/579] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:41 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:41.762177 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:41.770568 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4fa989b5-232d-4f88-bc4b-8d904427bde6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.167686 Aug 23 08:22:41.771197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 299/580] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:41 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:42.712448 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:42.713096 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:42.720043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:42.720621 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:42.721122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:42.721908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:42.722482 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:42.723066 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:42.795517 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:42.796125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:42.802269 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:42.802743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:42.803199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:42.803882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:42.804322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:42.805021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:42.887173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:42.896023 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:42.897545 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:42.898709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bfb033c6-a0ca-4596-a09a-5ad1b528d821 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.190882 Aug 23 08:22:42.899339 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 282/581] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:42 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:42.950618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:42.958671 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3b658963-9ca2-4f83-b507-2f3a3a2b1841 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.167103 Aug 23 08:22:42.959402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 300/582] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:42 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:43.922474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:43.923107 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:43.925392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=58 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:43.930053 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:43.930536 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:43.930987 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:43.931723 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:43.932130 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:43.932554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:43.981091 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:43.981707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:43.988606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:43.989094 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:43.989531 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:43.990222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:43.990676 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:43.991125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:44.103114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:44.111989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:44.113503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:44.114667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f549cdb3-1234-4cf3-aa31-8ad525b40757 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.196066 Aug 23 08:22:44.115282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 283/583] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:43 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:44.146223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:44.154469 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-da376ef2-a8db-4e44-9409-f1540fcbf9a6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.178902 Aug 23 08:22:44.155047 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 301/584] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:43 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:45.138248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:45.138853 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:45.145319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:45.145804 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:45.146241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:45.146935 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:45.147410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:45.147835 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:45.175226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:45.175831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:45.182636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:45.183139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:45.183563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:45.184239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:45.184679 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:45.185091 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:45.329453 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:45.338105 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:45.339664 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:45.340826 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-afd2b2b1-6500-4a70-a28e-5e14ea4cbc24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.207123 Aug 23 08:22:45.341390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 284/585] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:45 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:45.358843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:45.362892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2dedeb24-9a96-4cf5-93f8-f6d1f50d7ef1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.191548 Aug 23 08:22:45.363545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 302/586] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:45 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:46.363755 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:46.364306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:46.370928 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:46.371455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:46.371891 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:46.372658 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:46.373118 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:46.373540 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:46.429988 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-a3a6d857-a375-4911-9001-ab40927a2980 req-4b93b370-d221-4590-b52e-82fda457def5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab53478c-2139-4154-9a51-3760c278c8c3", "tag": "aa589549-304f-49d3-929c-bf7ebc1aae56"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:22:46.439552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-a3a6d857-a375-4911-9001-ab40927a2980 req-4b93b370-d221-4590-b52e-82fda457def5 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:46.440285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-a3a6d857-a375-4911-9001-ab40927a2980 req-4b93b370-d221-4590-b52e-82fda457def5 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:46.440716 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-a3a6d857-a375-4911-9001-ab40927a2980 req-4b93b370-d221-4590-b52e-82fda457def5 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:46.453074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-a3a6d857-a375-4911-9001-ab40927a2980 req-4b93b370-d221-4590-b52e-82fda457def5 service nova] Creating event network-changed:aa589549-304f-49d3-929c-bf7ebc1aae56 for instance ab53478c-2139-4154-9a51-3760c278c8c3 on hv-cinder-85407 Aug 23 08:22:46.458439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-a3a6d857-a375-4911-9001-ab40927a2980 req-4b93b370-d221-4590-b52e-82fda457def5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088970 Aug 23 08:22:46.459345 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 303/587] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:22:46.464361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:46.465043 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:46.471269 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:46.471734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:46.472165 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:46.472845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:46.473292 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:46.473710 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:46.530133 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:46.538910 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:46.540491 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:46.542308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9cc450a2-45ab-459e-9abf-bae61c61c8e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.182840 Aug 23 08:22:46.542879 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 285/588] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:46 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:22:46.612826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:46.620308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-905c9854-b1de-466b-ae84-453d8a88714a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.159930 Aug 23 08:22:46.620863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 304/589] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:46 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:47.565147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:47.565788 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:47.572236 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:47.573302 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:47.573742 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:47.574416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:47.574864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:47.575306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:47.641460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:47.642195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:47.648706 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:47.649192 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:47.649629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:47.650321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:47.650776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:47.651229 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:47.735450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:47.739222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:47.745969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:47.747638 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:47.748803 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b6f3f99b-5ce3-4f40-b42a-d08d2eb279b2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.187780 Aug 23 08:22:47.749541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 286/590] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:47 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:47.879670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:47.888795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e07f0f1d-9038-4c5c-b904-999e255e0639 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.251086 Aug 23 08:22:47.889736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 305/591] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:47 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:48.033929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5933d394-dffd-48cd-aa0b-da146aca8069"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:22:48.036452 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:48.043333 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:48.043920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:48.044419 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:48.045215 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:48.045734 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:48.046250 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:48.774550 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:48.775209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:48.782332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:48.782822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:48.783295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:48.784073 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:48.784530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:48.784962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:48.915021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:48.923665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:48.925220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:48.927244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-26c9ad77-730e-4e62-b1e1-74f1a048b975 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.155877 Aug 23 08:22:48.927244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 306/592] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:48 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:22:48.931249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:48.932434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:48.938011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:48.938652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:48.939118 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:48.939812 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:48.940520 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:48.940941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:49.070952 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:49.079168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-971b0f47-c36b-4ce6-9675-cdbd7f773d5c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.151234 Aug 23 08:22:49.079731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 307/593] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:48 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:49.340466 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:49.340968 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:49.346879 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:49.347393 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:49.347855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:49.348527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:49.348981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:49.349404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:49.373730 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:22:49.691407 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-41e444ac-f2c4-4375-b269-7a43b28a2862 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 204 len: 0 microversion: 2.1 time: 0.355099 Aug 23 08:22:49.692015 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 308/594] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:22:49 2022] DELETE /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 08:22:49.701041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:49.701726 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:49.707356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:49.707834 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:49.708269 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:49.708952 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:49.709407 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:49.709825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:49.837095 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:49.845201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8a0a3de8-c523-4b34-8320-6bc299605a2c tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1556 microversion: 2.1 time: 0.148699 Aug 23 08:22:49.845771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 309/595] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:49 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:49.949573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:49.950184 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:49.956154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:49.956621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:49.957062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:49.957791 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:49.958247 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:49.958673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:50.086067 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:50.094680 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:50.096219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:50.097370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9de85599-aca1-4ce2-9448-ba06b0820609 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.151690 Aug 23 08:22:50.097925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 310/596] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:49 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:22:50.102262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:50.102865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:50.109633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:50.110121 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:50.110576 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:50.111284 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:50.111747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:50.112175 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:50.241043 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:50.249102 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cb320761-4aef-40aa-ab1b-bbfb5ef85747 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.150238 Aug 23 08:22:50.249667 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 311/597] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:50 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:50.866198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:50.866810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:50.873404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:50.873890 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:50.874326 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:50.875046 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:50.875529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:50.875955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:51.002706 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:51.011382 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-02f3227e-c4b6-42d9-9344-2061bc9cde3b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1556 microversion: 2.1 time: 0.148947 Aug 23 08:22:51.011945 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 312/598] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:50 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:51.122357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:51.122887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:51.129017 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:51.129503 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:51.129956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:51.130694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:51.131264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:51.131723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:51.271901 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:51.280933 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:51.282432 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:51.283702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-58da980e-925e-4d14-80ac-1d1129fe6fb6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.165975 Aug 23 08:22:51.284260 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 313/599] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:51 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:22:51.288609 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:51.293316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:51.297997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:51.298480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:51.298915 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:51.299638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:51.300113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:51.300535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:51.304749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:22:51.430634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:51.444412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-290bcb87-f2a0-4d7b-8148-e2506fb388b1 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.159070 Aug 23 08:22:51.445006 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 314/600] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:51 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:51.586250 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-06db106f-5705-432f-b664-070ee1469a22 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.681271 Aug 23 08:22:51.586840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 287/601] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:22:47 2022] POST /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments => generated 194 bytes in 3683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:22:52.032405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:52.033004 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:52.039881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:52.040371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:52.040782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:52.042103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:52.042557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:52.042996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:52.170225 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:52.177944 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-49957e9e-ad4b-4bf6-b879-36e71f7e134f tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1510 microversion: 2.1 time: 0.149373 Aug 23 08:22:52.178504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 315/602] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:52 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:52.308910 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:52.309516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:52.316149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:52.316634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:52.317074 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:52.317765 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:52.318225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:52.318652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:52.450512 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:52.459266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:52.460869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:52.462035 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-eb1ca797-1656-4087-9c37-ac8942f00a2b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.157999 Aug 23 08:22:52.462586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 288/603] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:52 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:52.465634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:52.466238 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:52.472032 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:52.472504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:52.472958 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:52.473632 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:52.474074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:52.474507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:52.597743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:52.605205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0767b6d3-4454-46f9-a2a3-3d193acf24b3 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.144129 Aug 23 08:22:52.605765 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 316/604] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:52 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:53.199521 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:53.200135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:53.206577 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:53.207095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:53.207537 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:53.208229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:53.208685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:53.209110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:53.345279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:53.353261 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7fb79b3b-3624-4021-b81d-334452ec45d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1510 microversion: 2.1 time: 0.157705 Aug 23 08:22:53.354507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 289/605] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:53 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:53.485729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:53.486389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:53.493020 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:53.493502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:53.493938 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:53.494755 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:53.495234 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:53.495660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:53.625590 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:53.632299 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:53.632299 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:53.632817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:53.633093 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:53.633650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:53.634361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:53.635385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:53.635815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:53.641962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:53.643494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:53.644644 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2e86cade-06f7-4111-a970-5faadc354a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.162874 Aug 23 08:22:53.645197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 317/606] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:53 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:53.771265 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:53.779669 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-888803a6-2d3b-40a4-ad7a-dbf001e1d238 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.157966 Aug 23 08:22:53.780444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 290/607] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:53 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:54.379754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:54.380273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:54.386675 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:54.387201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:54.387631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:54.388303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:54.388751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:54.389164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:54.514625 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:54.522169 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-465a0165-efe8-443d-af36-dda88ea37770 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1510 microversion: 2.1 time: 0.146312 Aug 23 08:22:54.522724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 318/608] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:54 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1510 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:54.668435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:54.669042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:54.675416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:54.675901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:54.676335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:54.677018 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:54.677472 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:54.677890 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:54.800438 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:54.801044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:54.806222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:54.807156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:54.807643 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:54.808068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:54.808987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:54.809434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:54.810070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:54.815225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:54.816947 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:54.818101 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3f8931dd-b958-4d4f-991c-982af3455b12 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.154044 Aug 23 08:22:54.818653 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 291/609] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:54 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:54.940958 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:54.948493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7b0ef9aa-fa34-448e-92ff-d33332b7b4bc tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.151910 Aug 23 08:22:54.949052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 319/610] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:54 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:55.543733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:55.544385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:55.550848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:55.551519 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:55.552046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:55.552873 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:55.553427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:55.553992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:55.723868 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-3445ef18-f9a1-4c03-87ce-283c054fa718 req-559b68e1-4a06-46f1-a87e-c9c399d67b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab53478c-2139-4154-9a51-3760c278c8c3", "name": "network-vif-plugged", "status": "completed", "tag": "aa589549-304f-49d3-929c-bf7ebc1aae56"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:22:55.733524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3445ef18-f9a1-4c03-87ce-283c054fa718 req-559b68e1-4a06-46f1-a87e-c9c399d67b6a service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:55.734002 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3445ef18-f9a1-4c03-87ce-283c054fa718 req-559b68e1-4a06-46f1-a87e-c9c399d67b6a service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:55.738549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3445ef18-f9a1-4c03-87ce-283c054fa718 req-559b68e1-4a06-46f1-a87e-c9c399d67b6a service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:55.746605 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-3445ef18-f9a1-4c03-87ce-283c054fa718 req-559b68e1-4a06-46f1-a87e-c9c399d67b6a service nova] Creating event network-vif-plugged:aa589549-304f-49d3-929c-bf7ebc1aae56 for instance ab53478c-2139-4154-9a51-3760c278c8c3 on hv-cinder-85407 Aug 23 08:22:55.751722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-3445ef18-f9a1-4c03-87ce-283c054fa718 req-559b68e1-4a06-46f1-a87e-c9c399d67b6a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089798 Aug 23 08:22:55.752310 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 320/611] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:22:55.785863 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:55.794668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-eb40bcd0-af2c-4396-a142-077fcbc2cef8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1510 microversion: 2.1 time: 0.254972 Aug 23 08:22:55.795954 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 292/612] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:55 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:55.841851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:55.842810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:55.849841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:55.850646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:55.851314 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:55.852244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:55.852902 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:55.853636 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:55.969603 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:55.970308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:55.976464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:55.976958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:55.977402 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:55.978105 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:55.979084 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:55.979513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:56.023601 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:56.037827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:56.040593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:56.042507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-72288b7b-5ab3-4896-9e8e-01135c0104a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.205340 Aug 23 08:22:56.043581 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 321/613] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:55 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:56.139477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-e724708b-94d2-4fc1-9185-867d8256e356 req-3fe0b285-73e8-4e86-9d31-cb0e74631a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f551e6-2e0d-4d2c-a539-007f40fc0b2a", "name": "network-vif-deleted", "tag": "f9684eb6-9cdc-4571-81b6-89a182589779"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:22:56.149043 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-e724708b-94d2-4fc1-9185-867d8256e356 req-3fe0b285-73e8-4e86-9d31-cb0e74631a56 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:56.149566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-e724708b-94d2-4fc1-9185-867d8256e356 req-3fe0b285-73e8-4e86-9d31-cb0e74631a56 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:56.149989 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-e724708b-94d2-4fc1-9185-867d8256e356 req-3fe0b285-73e8-4e86-9d31-cb0e74631a56 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:56.163242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-e724708b-94d2-4fc1-9185-867d8256e356 req-3fe0b285-73e8-4e86-9d31-cb0e74631a56 service nova] Creating event network-vif-deleted:f9684eb6-9cdc-4571-81b6-89a182589779 for instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a on hv-cinder-85407 Aug 23 08:22:56.168758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-e724708b-94d2-4fc1-9185-867d8256e356 req-3fe0b285-73e8-4e86-9d31-cb0e74631a56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034807 Aug 23 08:22:56.169349 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 322/614] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:22:56.227644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:56.236232 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a791e014-679f-4a90-9d0d-d673b2210c5f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.270691 Aug 23 08:22:56.237637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 293/615] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:55 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:22:56.817956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:56.818649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:56.825391 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:56.825948 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:56.826389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:56.827103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:56.827589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:56.828022 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:56.859164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:56.859644 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:56.860175 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:56.860574 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lazy-loading 'fault' on Instance uuid 96f551e6-2e0d-4d2c-a539-007f40fc0b2a {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:22:56.901659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:56.909140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5a3e4ad8-a110-489f-921d-08c867b38bc8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1307 microversion: 2.1 time: 0.096236 Aug 23 08:22:56.909699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 323/616] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:56 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:57.066706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:57.067255 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:57.074299 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:57.074791 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:57.075267 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:57.075958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:57.076416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:57.076843 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:57.202240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:57.210750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:57.212288 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:57.213431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a10e2bed-639d-42a2-b42e-d11f9c3503e4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.151045 Aug 23 08:22:57.214007 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 294/617] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:57 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:57.257527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:57.258137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:57.264946 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:57.265422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:57.265854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:57.266536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:57.267075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:57.267525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:57.396509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:57.404073 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-455500d3-78db-4035-a2d0-c6830f9e03c9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1358 microversion: 2.1 time: 0.150450 Aug 23 08:22:57.404640 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 324/618] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:57 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:57.929638 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:57.930256 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:57.936330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:57.936817 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:57.937258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:57.937955 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:57.938415 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:57.938845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:57.970811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:57.971357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:57.971824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:57.972284 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lazy-loading 'fault' on Instance uuid 96f551e6-2e0d-4d2c-a539-007f40fc0b2a {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:22:58.022493 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:58.030798 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d69cbe1b-7b42-4cc4-adc7-41c93846bdd3 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 200 len: 1307 microversion: 2.1 time: 0.105044 Aug 23 08:22:58.031386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 295/619] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:57 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:58.236183 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:58.236720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:58.243165 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.243639 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.244068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.244742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.245195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.245604 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.379071 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:58.396817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:58.399551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:58.401355 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-96d350d4-fbb9-4864-8127-c6cfc4a9381e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.169124 Aug 23 08:22:58.401923 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 325/620] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:58 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:58.425820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:58.427064 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:58.433359 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.433836 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.434269 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.434998 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.435566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.435996 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.569308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:58.577718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1e447df8-d4ea-4467-bbb5-4358d4bf1c30 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1547 microversion: 2.1 time: 0.155848 Aug 23 08:22:58.578286 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 296/621] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:58 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:58.598337 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:58.598965 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:58.604897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.605379 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.605823 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.606510 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.606990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.607420 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.732743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:58.740422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0ffa3a1b-819f-4319-bae6-a51d176f8a00 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1547 microversion: 2.1 time: 0.145911 Aug 23 08:22:58.740987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 326/622] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:58 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:58.760736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:58.765656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:58.766363 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Searching by: {'deleted': False, 'project_id': 'd6382332279746739a247cfb7085cebf'} {{(pid=121383) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 08:22:58.772976 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.773460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.773897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.774631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.775125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.775553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.864901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.multi_cell_list [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121383) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 08:22:58.956582 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b0c2f6dd-b057-408c-816f-8a2aff694aa6 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200113 Aug 23 08:22:58.957165 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 297/623] 10.222.0.58 () {58 vars in 1125 bytes} [Tue Aug 23 08:22:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:22:58.969285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:58.969903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:58.975800 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.976280 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.976715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:58.977400 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:58.977860 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:58.978786 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:59.051769 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:59.052389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 96f551e6-2e0d-4d2c-a539-007f40fc0b2a] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:59.058971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:59.059497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:59.059939 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:59.060642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:59.061104 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:59.061532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:59.076345 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] HTTP exception thrown: Instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a could not be found. Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Request method failure captured: Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a HTTP/1.1 Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI3pDt_G9QQ9Ifcm51xNzTXoFaecgXCU68EYbZZBxFxagbAT_BVMwVNY51QrMgU0FAzCOg_29r1HfiFkaBAf3pe8lg7W45-yR7TnhYNFwfTgm_a1ial8ssBpRQ0XGr4tMGnBoLJ8SKhjBKvOiPSvXjLLRwThJQUoN-0_GIzshvlE-8o Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: ee175b1f398844f6be0075d3e127e8b3 Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1767759879 Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:22:59.078014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee175b1f398844f6be0075d3e127e8b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee175b1f398844f6be0075d3e127e8b3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee175b1f398844f6be0075d3e127e8b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee175b1f398844f6be0075d3e127e8b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-VolumesSnapshotTestJSON-1767759879 Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: ee175b1f398844f6be0075d3e127e8b3 Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1767759879 Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-VolumesSnapshotTestJSON-1767759879-project Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: a0a59ef94e054c3d8175e1c0f1ad783a Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-VolumesSnapshotTestJSON-1767759879-project Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a could not be found. Aug 23 08:22:59.079644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '96f551e6-2e0d-4d2c-a539-007f40fc0b2a'} Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a could not be found. Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:22:59.080525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a could not be found. Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a could not be found. Aug 23 08:22:59.081848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:22:59.083103 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Returning 404 to user: Instance 96f551e6-2e0d-4d2c-a539-007f40fc0b2a could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:22:59.083103 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8d28f904-913e-411d-bfc9-552fb33aa893 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a" status: 404 len: 111 microversion: 2.1 time: 0.031678 Aug 23 08:22:59.083103 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 298/624] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:59 2022] GET /compute/v2.1/servers/96f551e6-2e0d-4d2c-a539-007f40fc0b2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 08:22:59.112100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:59.120439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-829f843e-b063-4dec-9df8-36d73450b3ff tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1547 microversion: 2.1 time: 0.155988 Aug 23 08:22:59.121006 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 327/625] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:22:58 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:22:59.425191 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:22:59.425879 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:22:59.432538 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:59.433009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:59.433440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:59.434154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:59.434605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:59.435049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:59.588357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:59.597279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:59.599723 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:22:59.599962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-97782a76-b119-44ed-9e35-fee0e245e9e2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.179031 Aug 23 08:22:59.600688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 299/626] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:22:59 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:22:59.615659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-d3581b0d-df3b-4aa0-bd2e-5278c4006a22 req-104311b7-76b3-40ef-9403-5e39937a2457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895b9968-c8a0-4035-82f3-15a6726d65ed", "name": "network-vif-plugged", "status": "completed", "tag": "c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:22:59.629108 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-d3581b0d-df3b-4aa0-bd2e-5278c4006a22 req-104311b7-76b3-40ef-9403-5e39937a2457 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:22:59.629642 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-d3581b0d-df3b-4aa0-bd2e-5278c4006a22 req-104311b7-76b3-40ef-9403-5e39937a2457 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:22:59.630070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-d3581b0d-df3b-4aa0-bd2e-5278c4006a22 req-104311b7-76b3-40ef-9403-5e39937a2457 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:22:59.641827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-d3581b0d-df3b-4aa0-bd2e-5278c4006a22 req-104311b7-76b3-40ef-9403-5e39937a2457 service nova] Creating event network-vif-plugged:c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097 for instance 895b9968-c8a0-4035-82f3-15a6726d65ed on hv-cinder-85407 Aug 23 08:22:59.646788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-d3581b0d-df3b-4aa0-bd2e-5278c4006a22 req-104311b7-76b3-40ef-9403-5e39937a2457 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034852 Aug 23 08:22:59.647571 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 328/627] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:00.630678 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:00.631310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:00.638083 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:00.638620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:00.639091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:00.639937 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:00.640453 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:00.640909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:00.767849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:00.776906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:00.778423 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:00.779778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-02ad6f68-8bd7-4ad0-a410-23326a6857c8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.152960 Aug 23 08:23:00.780383 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 300/628] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:00 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:23:01.804021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:01.804711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:01.811995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:01.812484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:01.812916 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:01.813600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:01.814057 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:01.814481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:01.946662 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:01.955388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:01.956839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:01.958044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ac3a3152-2f96-40c4-a175-f52418ed9808 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.158328 Aug 23 08:23:01.958589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 329/629] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:01 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:23:02.981123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:02.981738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:02.988124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:02.988614 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:02.989086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:02.989775 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:02.990256 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:02.990683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:03.117458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:03.125953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:03.127486 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:03.128665 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5c4c0fa2-b1f6-41b5-9153-4bdf074b051d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.151851 Aug 23 08:23:03.129227 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 301/630] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:02 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:23:04.151119 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:04.151722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:04.158462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:04.158961 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:04.161115 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:04.161115 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:04.161115 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:04.161115 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:04.364526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:04.373455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:04.374951 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:04.376114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c2d45fa3-9665-4d47-9712-960d25bc0c68 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.229589 Aug 23 08:23:04.376675 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 330/631] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:04 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:23:05.248049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "144a904c-bc28-4729-9fdc-303e12f2cc3f"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:05.250532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:05.257036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:05.261684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:05.261684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:05.261684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:05.261684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:05.262241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:05.263364 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:05.400423 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:05.401041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:05.407522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:05.408050 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:05.408493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:05.409178 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:05.409631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:05.410055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:05.536527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:05.545804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:05.547332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:05.548490 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a59fac41-69c9-43dc-bb1b-7cc899584e30 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.152636 Aug 23 08:23:05.549081 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 331/632] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:05 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:23:06.553924 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:06.557184 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:06.563836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:06.564328 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:06.566551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:06.566551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:06.566551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:06.566826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:06.588589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:06.592839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lazy-loading 'flavor' on Instance uuid 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:23:07.035917 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-851a7eff-b67e-4235-92ab-57c8ac420b67 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/action" status: 200 len: 32 microversion: 2.1 time: 0.486156 Aug 23 08:23:07.036522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 332/633] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:23:06 2022] POST /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/action => generated 32 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:23:07.042840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:07.043583 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:07.049882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:07.050365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:07.050801 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:07.051530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:07.051986 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:07.052413 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:07.129369 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9657e08d-d7c0-4c03-8460-eed36ee3f06f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "POST /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.885846 Aug 23 08:23:07.135878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 302/634] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:23:05 2022] POST /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments => generated 194 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:07.135878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:07.136645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:07.143242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:07.143796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:07.144183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:07.144883 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:07.145348 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:07.145768 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:07.197867 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:07.206687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:07.208236 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:07.209380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-009832fd-f7a1-4b67-9d9c-db326bcca031 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.171678 Aug 23 08:23:07.210694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 333/635] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:07 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:23:07.279321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:07.287571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-43a4acea-c035-4921-a2ef-a9e5eaa80117 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.156308 Aug 23 08:23:07.288227 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 303/636] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:07 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:08.233931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:08.234530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:08.236905 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:08.241601 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:08.242088 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:08.242515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:08.243219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:08.243669 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:08.244738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:08.309095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:08.309695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:08.316475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:08.316957 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:08.317389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:08.318068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:08.318520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:08.318959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:08.409364 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:08.418615 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:08.420175 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:08.421430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-decde0a3-8ab7-4001-920f-fe971708f735 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.191315 Aug 23 08:23:08.422186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 334/637] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:08 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:23:08.464922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:08.473058 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-106068a1-cf4b-4cc0-957b-83db522cb71b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.167980 Aug 23 08:23:08.473609 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 304/638] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:08 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:09.443988 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:09.444597 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:09.451469 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:09.455356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:09.455356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:09.455356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:09.455356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:09.455739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:09.495323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:09.497220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:09.500111 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:09.505650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:09.506083 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:09.506532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:09.507261 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:09.507728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:09.508159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:09.623934 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:09.632819 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:09.634370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:09.636093 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7168fa77-4da5-4581-999d-aa36301af3f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.196252 Aug 23 08:23:09.636652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 335/639] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:09 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:23:09.667593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:09.675709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-04553af8-ddc7-4f3c-9d9c-7929f77e13b1 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.184929 Aug 23 08:23:09.676274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 305/640] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:09 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:10.659518 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:10.660149 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:10.666327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:10.667728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:10.667857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:10.668551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:10.668995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:10.669411 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:10.696905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:10.697516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:10.704209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:10.704703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:10.705155 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:10.705827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:10.706284 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:10.706705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:10.859602 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:10.868495 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:10.869929 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:10.871129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d716de48-2363-43df-b7f1-f2c258e40c52 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1808 microversion: 2.20 time: 0.215417 Aug 23 08:23:10.871848 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 336/641] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:10 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:23:10.889155 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:10.897456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d16d0fff-f36b-4901-8610-74d099c457e9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.204317 Aug 23 08:23:10.898019 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 306/642] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:10 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:11.765586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-424074252", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "networks": [{"uuid": "22b0218f-c6dc-43aa-90b7-325e4ad9a48c"}]}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:11.817914 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] validate_networks() for [('22b0218f-c6dc-43aa-90b7-325e4ad9a48c', None, None, None, None, None)] {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:23:11.894733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:11.895384 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:11.901989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:11.902479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:11.902920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:11.903650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:11.904110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:11.904541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:12.076483 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:12.085408 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:12.086907 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:12.088083 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3fc752ee-1216-4e9f-90a1-73721ab09f2f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1795 microversion: 2.20 time: 0.197500 Aug 23 08:23:12.089127 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 307/643] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:23:11 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1795 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:23:12.093435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:12.094252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:12.099797 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:12.100293 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:12.100729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:12.101418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:12.101907 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:12.102330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:12.334861 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:12.344048 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-99158ea9-63dd-4eb9-bb14-cad0f06681f2 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.253931 Aug 23 08:23:12.344841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 308/644] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:12 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:12.362757 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:23:12.363170 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:23:12.363643 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:23:12.364049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:23:12.364457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:23:12.373369 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:12.373851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:12.374341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:12.375106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:12.375561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:12.375985 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:12.393545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Getting quotas for project ee175b1f398844f6be0075d3e127e8b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:23:12.397707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Getting quotas for user a0a59ef94e054c3d8175e1c0f1ad783a and project ee175b1f398844f6be0075d3e127e8b3. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:23:12.409708 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:23:12.412079 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:23:12.589306 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-20649fa8-ce21-493f-ab84-e0a1fd2a4e44 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826887 Aug 23 08:23:12.590130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 337/645] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:23:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:23:12.601153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0d97c6f9-5abf-4049-8d40-84b50d5f4494 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:12.601768 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0d97c6f9-5abf-4049-8d40-84b50d5f4494 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:12.664514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0d97c6f9-5abf-4049-8d40-84b50d5f4494 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:12.671911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0d97c6f9-5abf-4049-8d40-84b50d5f4494 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1218 microversion: 2.1 time: 0.074492 Aug 23 08:23:12.672480 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 309/646] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:12 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:13.366226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:13.366828 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:13.373465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:13.373931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:13.374384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:13.375537 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:13.375643 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:13.375978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:13.507166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:13.515904 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f2a2e1a5-4449-4c72-950a-1f0dd1288eca tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.154128 Aug 23 08:23:13.516720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 338/647] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:13 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:13.692459 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:13.693075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:13.699451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:13.699939 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:13.700378 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:13.701075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:13.701534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:13.701958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:13.763215 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:13.771124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a47075c0-90c7-4f02-90a0-16b9fffdb666 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1222 microversion: 2.1 time: 0.082965 Aug 23 08:23:13.771693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 310/648] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:13 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:14.545224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:14.545224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:14.545773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:14.545773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:14.546360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:14.547112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:14.547565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:14.548025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:14.676009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:14.684654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-02fbe3bb-e3cc-460c-b3e4-32a365bccc37 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.151088 Aug 23 08:23:14.685248 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 339/649] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:14 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:14.792908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:14.793916 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:14.802507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=60 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:14.802507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:14.802507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:14.802507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:14.803011 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:14.803011 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:14.803196 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:14.871668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:14.879682 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c2f42c27-9316-48be-8b97-a16cbb45d9e0 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1270 microversion: 2.1 time: 0.091116 Aug 23 08:23:14.880444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 311/650] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:14 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:15.705885 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:15.706455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:15.713012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:15.714004 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:15.714437 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:15.715573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:15.715693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:15.716186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:15.900757 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:15.901979 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:15.908471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:15.909031 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:15.909536 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:15.910297 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:15.910758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:15.911215 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:15.922031 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:15.930843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6319081f-4381-4726-bcec-6f30f2773c87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.228863 Aug 23 08:23:15.931528 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 340/651] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:15 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:15.984342 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:15.992031 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0bdcb55f-33f4-41aa-8cba-3b433dc561a6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1276 microversion: 2.1 time: 0.095283 Aug 23 08:23:15.992592 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 312/652] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:15 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1276 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:16.951938 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:16.952550 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:16.959364 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:16.959851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:16.960305 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:16.960986 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:16.961442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:16.961870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:16.967908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-abebac46-46a1-42e9-af56-ada7b3e33cd1 req-c369ccc7-5ed7-4774-bd22-5aa57ea02040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "192c6788-aad3-4eed-a9bf-2b29cf744295", "tag": "3f11dfe7-6852-4ec4-90f1-1be712701c18"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:16.988534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-abebac46-46a1-42e9-af56-ada7b3e33cd1 req-c369ccc7-5ed7-4774-bd22-5aa57ea02040 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:16.989026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-abebac46-46a1-42e9-af56-ada7b3e33cd1 req-c369ccc7-5ed7-4774-bd22-5aa57ea02040 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:16.989446 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-abebac46-46a1-42e9-af56-ada7b3e33cd1 req-c369ccc7-5ed7-4774-bd22-5aa57ea02040 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:17.001440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-abebac46-46a1-42e9-af56-ada7b3e33cd1 req-c369ccc7-5ed7-4774-bd22-5aa57ea02040 service nova] Creating event network-changed:3f11dfe7-6852-4ec4-90f1-1be712701c18 for instance 192c6788-aad3-4eed-a9bf-2b29cf744295 on hv-cinder-85407 Aug 23 08:23:17.007747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-abebac46-46a1-42e9-af56-ada7b3e33cd1 req-c369ccc7-5ed7-4774-bd22-5aa57ea02040 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042418 Aug 23 08:23:17.007747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 313/653] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:17.015938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:17.016642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:17.022867 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:17.023400 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:17.023841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:17.024542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:17.025001 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:17.025442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:17.195702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:17.204011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-86af2655-6bd1-413f-b34e-2c0aadae4ae9 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.256016 Aug 23 08:23:17.204594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 341/654] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:16 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:17.255263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:17.262837 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ac7d82a7-dc98-4bcf-9757-ba5e1a18f537 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.251128 Aug 23 08:23:17.263433 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 314/655] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:17 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:18.225874 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:18.226413 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:18.232735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:18.233219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:18.233658 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:18.234341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:18.234795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:18.235245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:18.283472 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:18.284082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:18.290464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:18.290963 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:18.291429 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:18.292126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:18.292587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:18.293013 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:18.398502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:18.406850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-14f35c67-830a-4c91-959b-2dc41a91e181 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.184913 Aug 23 08:23:18.407448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 342/656] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:18 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:18.442132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:18.449680 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-fc42414f-f8f6-49ac-8924-63f54a3d3553 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.170090 Aug 23 08:23:18.450240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 315/657] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:18 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:19.431041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:19.431680 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:19.438050 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:19.438532 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:19.438988 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:19.439679 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:19.440134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:19.440813 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:19.470073 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:19.470687 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:19.477087 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:19.477580 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:19.478017 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:19.478715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:19.479205 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:19.479919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:19.623220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:19.631339 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0b9d834d-9ff0-47bd-90e8-596b44de5127 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.206707 Aug 23 08:23:19.632125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 343/658] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:19 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:19.648652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:19.656343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8c371fa7-88a5-487b-ac1c-dc2b2d6bb844 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.190087 Aug 23 08:23:19.656918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 316/659] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:19 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:19.989475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:19.990098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:19.996555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:19.997030 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:19.997462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:19.998140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:19.998589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:19.999039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:20.125361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:20.133552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0107d705-aa98-49f3-8d75-7d9a975a72dd tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1593 microversion: 2.1 time: 0.147847 Aug 23 08:23:20.134117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 344/660] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:19 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1593 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:20.653337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:20.653937 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:20.660231 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:20.660710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:20.661135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:20.661815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:20.662264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:20.662699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:20.676846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:20.677550 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:20.684592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:20.685076 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:20.685509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:20.686203 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:20.686659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:20.687112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:20.949579 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:20.957645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-076d64fd-d5fa-4812-858c-5d22c2f137ee tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.308239 Aug 23 08:23:20.958211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 317/661] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:20 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:20.973995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:20.982144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3a303c9f-fc78-4813-94a2-6d6431141a6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.309214 Aug 23 08:23:20.982713 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 345/662] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:20 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:21.978737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:21.979909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:21.986038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:21.988194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:21.988194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:21.988194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:21.988194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:21.988619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:22.002362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:22.003579 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:22.010190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:22.011266 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:22.012480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:22.013193 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:22.013655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:22.014212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:22.314525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:22.322473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-44cc8ba1-1294-4b34-bdab-8d53490802d6 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.324490 Aug 23 08:23:22.323155 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 346/663] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:21 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:22.333293 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:22.342530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-73bb4e08-fe0d-4270-9cf1-0e9bdd865173 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.367710 Aug 23 08:23:22.343218 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 318/664] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:21 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:22.710891 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-ee42ac4c-eac2-46c3-b8c1-f371fd94b17f req-610b3864-d40b-45c1-9036-b02578dc7502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab53478c-2139-4154-9a51-3760c278c8c3", "tag": "aa589549-304f-49d3-929c-bf7ebc1aae56"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:22.716289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:22.717055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=6 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:22.722435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ee42ac4c-eac2-46c3-b8c1-f371fd94b17f req-610b3864-d40b-45c1-9036-b02578dc7502 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:22.722916 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ee42ac4c-eac2-46c3-b8c1-f371fd94b17f req-610b3864-d40b-45c1-9036-b02578dc7502 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:22.723360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ee42ac4c-eac2-46c3-b8c1-f371fd94b17f req-610b3864-d40b-45c1-9036-b02578dc7502 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:22.735459 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-ee42ac4c-eac2-46c3-b8c1-f371fd94b17f req-610b3864-d40b-45c1-9036-b02578dc7502 service nova] Creating event network-changed:aa589549-304f-49d3-929c-bf7ebc1aae56 for instance ab53478c-2139-4154-9a51-3760c278c8c3 on hv-cinder-85407 Aug 23 08:23:22.740982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-ee42ac4c-eac2-46c3-b8c1-f371fd94b17f req-610b3864-d40b-45c1-9036-b02578dc7502 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034106 Aug 23 08:23:22.741652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 347/665] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:23.344135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:23.344762 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:23.346841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:23.354742 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:23.355277 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:23.355763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:23.364432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:23.364941 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:23.365291 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:23.369257 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:23.369412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:23.371047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:23.373421 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:23.373938 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:23.374366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:23.375283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:23.375739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:23.376163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:23.396273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:23.568490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:23.580754 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8919ce7a-f20d-45ae-bc6d-703330deeaf7 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.240464 Aug 23 08:23:23.581350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 319/666] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:23 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:23.584525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:23.599725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-64069c42-2db3-46f0-98be-b9ad6069d12b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.239276 Aug 23 08:23:23.611122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 348/667] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:23 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:24.601648 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:24.602347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:24.609947 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:24.610501 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:24.611026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:24.611780 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:24.612303 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:24.612750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:24.624188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:24.625658 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:24.633997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:24.634567 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:24.635327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:24.636046 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:24.636488 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:24.637126 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:24.867293 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:24.872343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:24.875809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d4ba17f7-308f-4b9e-ab29-5d1b9cadea37 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.278040 Aug 23 08:23:24.876457 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 320/668] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:24 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:24.878518 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f4b711dc-c4c4-47a3-a5f9-8f9ea821b9e7 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.260320 Aug 23 08:23:24.879176 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 349/669] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:24 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:25.385688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1233437150"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:25.386233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:25.392182 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:25.392670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:25.393109 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:25.393798 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:25.394259 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:25.394752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:25.519965 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.network.security_group_api [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Adding security group 98f6c1c2-e258-480a-ac97-73d0ccc158fa to port aa589549-304f-49d3-929c-bf7ebc1aae56 Aug 23 08:23:25.896866 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:25.897613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:25.904170 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:25.904957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:25.905079 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:25.905851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:25.906339 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:25.906697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:25.909397 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d36d0995-6a4a-4a9e-81ab-48af92e719f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "POST /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/action" status: 202 len: 0 microversion: 2.1 time: 0.528268 Aug 23 08:23:25.910028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 321/670] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:23:25 2022] POST /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:23:25.915751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:25.916893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:25.923240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:25.923732 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:25.924170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:25.924901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:25.925517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:25.926104 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:26.361511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:26.363814 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:26.370696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-52732a46-6d15-473d-ab61-ebc7cdc98ceb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.459302 Aug 23 08:23:26.371844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 322/671] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:25 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:26.376975 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:26.377610 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:26.384659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e5f4d068-fd7b-4e5c-b4c5-bd8d4979fcd8 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.479384 Aug 23 08:23:26.390681 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:26.390829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 350/672] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:25 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:26.390915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:26.390915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:26.390915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:26.390915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:26.391241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:26.394816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-49174df1-8fee-416a-ac08-0e650af93b6c req-2e9caecc-f659-4980-a9ab-6d796c968845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab53478c-2139-4154-9a51-3760c278c8c3", "tag": "aa589549-304f-49d3-929c-bf7ebc1aae56"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:26.405001 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-49174df1-8fee-416a-ac08-0e650af93b6c req-2e9caecc-f659-4980-a9ab-6d796c968845 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:26.405529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-49174df1-8fee-416a-ac08-0e650af93b6c req-2e9caecc-f659-4980-a9ab-6d796c968845 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:26.406055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-49174df1-8fee-416a-ac08-0e650af93b6c req-2e9caecc-f659-4980-a9ab-6d796c968845 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:26.417858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-49174df1-8fee-416a-ac08-0e650af93b6c req-2e9caecc-f659-4980-a9ab-6d796c968845 service nova] Creating event network-changed:aa589549-304f-49d3-929c-bf7ebc1aae56 for instance ab53478c-2139-4154-9a51-3760c278c8c3 on hv-cinder-85407 Aug 23 08:23:26.423240 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-49174df1-8fee-416a-ac08-0e650af93b6c req-2e9caecc-f659-4980-a9ab-6d796c968845 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036709 Aug 23 08:23:26.424244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 351/673] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:26.429970 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-8df16e7c-763a-4754-87b4-9bfd66ba8d36 req-5674983b-8411-4720-b779-f3a920209318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192c6788-aad3-4eed-a9bf-2b29cf744295", "name": "network-vif-plugged", "status": "completed", "tag": "3f11dfe7-6852-4ec4-90f1-1be712701c18"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:26.441442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-8df16e7c-763a-4754-87b4-9bfd66ba8d36 req-5674983b-8411-4720-b779-f3a920209318 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:26.447149 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-8df16e7c-763a-4754-87b4-9bfd66ba8d36 req-5674983b-8411-4720-b779-f3a920209318 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:26.447149 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-8df16e7c-763a-4754-87b4-9bfd66ba8d36 req-5674983b-8411-4720-b779-f3a920209318 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:26.455810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-8df16e7c-763a-4754-87b4-9bfd66ba8d36 req-5674983b-8411-4720-b779-f3a920209318 service nova] Creating event network-vif-plugged:3f11dfe7-6852-4ec4-90f1-1be712701c18 for instance 192c6788-aad3-4eed-a9bf-2b29cf744295 on hv-cinder-85407 Aug 23 08:23:26.460895 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-8df16e7c-763a-4754-87b4-9bfd66ba8d36 req-5674983b-8411-4720-b779-f3a920209318 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035134 Aug 23 08:23:26.461558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 352/674] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:26.548066 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:26.556891 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-613f10d4-7d86-41da-8f69-bcaa028e3801 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1759 microversion: 2.1 time: 0.183942 Aug 23 08:23:26.558261 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 323/675] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:26 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:27.398707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:27.399354 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:27.405558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:27.406038 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:27.406147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:27.406661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:27.407135 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:27.407832 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:27.408288 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:27.408714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:27.412690 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:27.413180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:27.413615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:27.414304 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:27.414756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:27.415202 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:27.600665 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:27.609895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:27.610854 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-119a3df0-800b-46b7-a186-aa0b27b9f299 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.216391 Aug 23 08:23:27.611470 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 353/676] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:27 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:27.618065 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-54a1adcb-3af1-4ace-b17a-d01bfc740c17 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.216226 Aug 23 08:23:27.618620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 324/677] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:27 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:28.632554 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:28.633165 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:28.639825 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:28.640254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:28.640435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:28.640631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:28.641065 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:28.641755 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:28.642216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:28.642640 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:28.647737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:28.647737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:28.647969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:28.648518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:28.648979 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:28.649404 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:28.833494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:28.838030 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:28.841770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d876bacc-1c7d-4d86-990d-d84fbff73b44 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.213049 Aug 23 08:23:28.842334 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 354/678] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:28 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:28.845783 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e94abd69-a678-4090-9bc2-07961a192ebe tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1318 microversion: 2.1 time: 0.210338 Aug 23 08:23:28.846422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 325/679] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:28 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:29.862737 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:29.863376 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:29.866624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:29.867335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:29.869855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:29.870348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:29.870783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:29.871507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:29.871964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:29.872388 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:29.873759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:29.874260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:29.874726 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:29.875449 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:29.875908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:29.876339 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:30.066926 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:30.069445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:30.076729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-57d0aa85-e196-4f7b-a4d7-aa3b3307d76a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.217869 Aug 23 08:23:30.077312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 355/680] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:29 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:30.078237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1da652f5-0068-41e4-995e-8ce932b123ed tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1505 microversion: 2.1 time: 0.215450 Aug 23 08:23:30.078800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 326/681] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:29 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:23:30.098672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8bda444a-85fe-41c1-aaa4-b254548e29ff", "device": "/dev/sdb"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:30.101582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:30.107470 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:30.107941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:30.108372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:30.109054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:30.109509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:30.109932 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:30.843860 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ba39ff80-ad7e-41c4-9a26-dae3651a2f6e tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "POST /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749283 Aug 23 08:23:30.844463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 356/682] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:23:30 2022] POST /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:23:31.098058 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:31.098455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:31.105758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:31.106291 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:31.106725 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:31.107481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:31.107970 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:31.108419 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:31.239350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:31.248032 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-65800fc5-11dc-46c9-9289-910e0ba92f76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.154129 Aug 23 08:23:31.248599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 327/683] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:31 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:32.270666 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:32.271312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:32.277445 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:32.277926 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:32.278358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:32.279104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:32.279553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:32.279971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:32.407821 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:32.415928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-03cbc51e-cd9c-47b2-8f1a-1f594066bdef tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.150077 Aug 23 08:23:32.416524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 357/684] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:32 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:33.436807 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:33.437418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:33.444108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:33.444594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:33.445034 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:33.445722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:33.446179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:33.446601 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:33.576411 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:33.584600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ce2aa875-4902-4423-8854-7d7a7016dd92 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.151625 Aug 23 08:23:33.585159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 328/685] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:33 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:34.606550 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:34.607182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:34.613841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:34.614325 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:34.614759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:34.615487 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:34.615939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:34.616362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:34.745682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:34.753815 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3eb6c470-1cd6-45f9-891d-60d47746cd40 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.151809 Aug 23 08:23:34.754382 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 358/686] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:34 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:35.774721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:35.775365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:35.781852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:35.782346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:35.782805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:35.783558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:35.784024 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:35.784450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:35.913136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:35.922178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-51221f41-57a4-4172-bcb2-cbd1219e427a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1734 microversion: 2.1 time: 0.151377 Aug 23 08:23:35.922816 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 329/687] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:35 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:36.944847 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:36.945489 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:36.953309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:36.953800 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:36.954237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:36.954928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:36.955435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:36.955864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:37.088704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:37.097125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d4a2dd1f-88e5-4738-8989-f27fa6450b87 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1714 microversion: 2.1 time: 0.156366 Aug 23 08:23:37.099715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 359/688] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:36 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1714 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:37.181393 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:37.185932 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:37.188976 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:37.189477 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:37.189908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:37.190564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:37.191312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:37.191738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:37.315302 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] HTTP exception thrown: Cannot 'detach_volume' instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd while it is in vm_state rescued Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Request method failure captured: Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments/5933d394-dffd-48cd-aa0b-da146aca8069 HTTP/1.1 Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0BCWc2oRmFZ1_zUztLlLniSOHZHpEyOoVAXyhpSePuz5nzpZ6FXuN3fD3VReZe3nNTxgolkDgsAp1R3ShC1Ys-yJhdYL5m_4hgDoT1V9fakcuefZXvA-rn6Alpx9Pv-1WWTWriqZTXJDyjo-_jIbZPcNCVMRv7q8bknNFyG3yxtEc Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:23:37.318558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cfd891d8d1b7436fabfa2c48019c3565", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: b3c984088c0448f8abc0a0b60b820b3e Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:23:37.320271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Cannot 'detach_volume' instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd while it is in vm_state rescued Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'server_id': '3184a3f4-7eb5-47f7-8cf6-74e4848f11dd', 'id': '5933d394-dffd-48cd-aa0b-da146aca8069'} Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:23:37.321085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd while it is in vm_state rescued Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd while it is in vm_state rescued Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:23:37.322756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Returning 409 to user: Cannot 'detach_volume' instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd while it is in vm_state rescued {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:23:37.324257 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7abc3e4c-aaa4-43ef-b54b-d05214a27f8b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments/5933d394-dffd-48cd-aa0b-da146aca8069" status: 409 len: 152 microversion: 2.1 time: 0.141111 Aug 23 08:23:37.324257 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 330/689] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:23:37 2022] DELETE /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments/5933d394-dffd-48cd-aa0b-da146aca8069 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 08:23:37.327443 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:37.328010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:37.333838 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:37.334324 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:37.334759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:37.335472 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:37.335926 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:37.336348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:37.545986 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-54899622-f355-4b91-9692-fb45d6928980 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "POST /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/action" status: 202 len: 0 microversion: 2.1 time: 0.222063 Aug 23 08:23:37.546782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 360/690] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:23:37 2022] POST /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:23:37.554682 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:37.555307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:37.562365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:37.562882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:37.563344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:37.564024 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:37.564477 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:37.564897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:37.692555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:37.700744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-093dfe34-9869-4d97-a24a-9dd1b7335469 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1722 microversion: 2.1 time: 0.150043 Aug 23 08:23:37.701306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 331/691] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:37 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:38.722500 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:38.723983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:38.725131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:38.729924 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:38.730912 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:38.731377 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:38.732068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:38.732520 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:38.732942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:38.943975 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:38.953068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1a9f8a34-9a98-4a79-afb3-f3b270b5263c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1722 microversion: 2.1 time: 0.235225 Aug 23 08:23:38.964540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 361/692] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:38 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:39.973661 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:39.974272 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:39.980868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:39.981355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:39.981793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:39.982481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:39.982957 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:39.983385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:40.115266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:40.123984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e1981e9a-3028-4897-b073-29f4fdb86ea5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1722 microversion: 2.1 time: 0.154266 Aug 23 08:23:40.124545 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 332/693] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:39 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:41.144905 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:41.145435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:41.152957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:41.153444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:41.153882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:41.154578 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:41.155074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:41.155504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:41.280781 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:41.288938 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e961d97b-7264-4c01-b171-af309f32f73c tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1722 microversion: 2.1 time: 0.148013 Aug 23 08:23:41.289501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 362/694] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:41 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:42.309809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:42.310436 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:42.317248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:42.317737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:42.318175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:42.318870 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:42.319358 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:42.319793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:42.445729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:42.454412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7ef82ae2-cbe8-4e02-8257-d32b9dfe541b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1722 microversion: 2.1 time: 0.148452 Aug 23 08:23:42.454989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 333/695] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:42 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:43.476119 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:43.476732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:43.483686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:43.484168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:43.484604 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:43.485283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:43.485734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:43.486154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:43.618496 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:43.626561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-db9d3c29-20ee-4206-ab64-116d0c770bc4 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1722 microversion: 2.1 time: 0.154375 Aug 23 08:23:43.627141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 363/696] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:43 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:44.647646 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:44.648184 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:44.654921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:44.655445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:44.655894 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:44.656588 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:44.657049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:44.657476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:44.787386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:44.797006 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7411e6b4-06a8-4cbc-a477-ba33cefa5b7d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1722 microversion: 2.1 time: 0.153224 Aug 23 08:23:44.797793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 334/697] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:44 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:45.820113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:45.821359 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:45.828781 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:45.829277 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:45.829824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:45.830572 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:45.831058 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:45.831485 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:45.835511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:45.976595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:45.985439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-baf99742-fb64-44f6-833c-441ff01a0a5f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1722 microversion: 2.1 time: 0.169423 Aug 23 08:23:45.985807 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 364/698] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:45 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:47.006792 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:47.007425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:47.009741 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=48 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:47.014426 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:47.014911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:47.015375 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:47.016067 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:47.016527 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:47.016954 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:47.147304 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:47.155440 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4b199eb2-e76a-430a-b88f-ecd1294b84a5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1728 microversion: 2.1 time: 0.152978 Aug 23 08:23:47.156004 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 335/699] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:47 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:23:47.175615 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:47.176107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:47.182653 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:47.187560 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:47.187560 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:47.187560 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:47.187560 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:47.188001 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:47.259844 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b9a2380b-3025-449d-a8ec-f8b3b6dd13a3 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088362 Aug 23 08:23:47.260429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 365/700] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Aug 23 08:23:47 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:48.244089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-ec30d67f-8378-4f78-a793-1cc229687793 req-d68741f0-9827-4222-a633-bea02b8dcbf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3184a3f4-7eb5-47f7-8cf6-74e4848f11dd", "tag": "d0bb753d-02ab-4eee-bd85-09531cfa16df"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:48.254378 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ec30d67f-8378-4f78-a793-1cc229687793 req-d68741f0-9827-4222-a633-bea02b8dcbf2 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:48.254867 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ec30d67f-8378-4f78-a793-1cc229687793 req-d68741f0-9827-4222-a633-bea02b8dcbf2 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:48.255332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ec30d67f-8378-4f78-a793-1cc229687793 req-d68741f0-9827-4222-a633-bea02b8dcbf2 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:48.259367 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:23:48.266629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-ec30d67f-8378-4f78-a793-1cc229687793 req-d68741f0-9827-4222-a633-bea02b8dcbf2 service nova] Creating event network-changed:d0bb753d-02ab-4eee-bd85-09531cfa16df for instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd on hv-cinder-85407 Aug 23 08:23:48.273212 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-ec30d67f-8378-4f78-a793-1cc229687793 req-d68741f0-9827-4222-a633-bea02b8dcbf2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032433 Aug 23 08:23:48.273823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 336/701] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:50.288408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-5c8a213e-53c2-457b-83e0-b03c0480711e req-04b4004a-e827-4eaa-baff-c6c690f6109d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3184a3f4-7eb5-47f7-8cf6-74e4848f11dd", "tag": "d0bb753d-02ab-4eee-bd85-09531cfa16df"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:23:50.298343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-5c8a213e-53c2-457b-83e0-b03c0480711e req-04b4004a-e827-4eaa-baff-c6c690f6109d service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:50.298814 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-5c8a213e-53c2-457b-83e0-b03c0480711e req-04b4004a-e827-4eaa-baff-c6c690f6109d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:50.299272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-5c8a213e-53c2-457b-83e0-b03c0480711e req-04b4004a-e827-4eaa-baff-c6c690f6109d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:50.310161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-5c8a213e-53c2-457b-83e0-b03c0480711e req-04b4004a-e827-4eaa-baff-c6c690f6109d service nova] Creating event network-changed:d0bb753d-02ab-4eee-bd85-09531cfa16df for instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd on hv-cinder-85407 Aug 23 08:23:50.315200 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-5c8a213e-53c2-457b-83e0-b03c0480711e req-04b4004a-e827-4eaa-baff-c6c690f6109d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030936 Aug 23 08:23:50.315757 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 366/702] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:23:56.168711 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:56.169290 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:56.175853 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:56.176339 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:56.176776 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:56.177464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:56.177922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:56.178345 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:56.257248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lazy-loading 'services' on Instance uuid 192c6788-aad3-4eed-a9bf-2b29cf744295 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:23:56.508246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f3f04e0d-afa6-452c-934d-2ac9e1e6c3c5 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295/os-volume_attachments/8bda444a-85fe-41c1-aaa4-b254548e29ff" status: 202 len: 0 microversion: 2.1 time: 0.343865 Aug 23 08:23:56.508828 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 337/703] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:23:56 2022] DELETE /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295/os-volume_attachments/8bda444a-85fe-41c1-aaa4-b254548e29ff => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:23:58.687519 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:58.688099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:58.694782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:58.695287 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:58.695722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:58.696433 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:58.696888 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:58.697309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:58.721593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:23:59.015249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4ab9cfc1-e10e-46dd-ac3c-c5626890c308 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "DELETE /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 204 len: 0 microversion: 2.1 time: 0.332202 Aug 23 08:23:59.016070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 367/704] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:23:58 2022] DELETE /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:23:59.025831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:23:59.026533 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:23:59.032802 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:59.033292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:59.033733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:59.034425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:23:59.034883 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:23:59.035390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:23:59.164286 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:23:59.171904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-66bf1dd3-fd07-427b-bfa7-5be2d4bacb51 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1511 microversion: 2.1 time: 0.151575 Aug 23 08:23:59.172465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 338/705] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:23:59 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:24:00.193515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:00.194211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:00.200573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:00.201052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:00.201483 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:00.202164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:00.202613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:00.203063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:00.332863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:00.341053 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d95d9a00-4e76-404e-8894-7a637693ac2b tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1511 microversion: 2.1 time: 0.152027 Aug 23 08:24:00.341607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 368/706] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:00 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:24:01.361584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:01.362170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:01.369393 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:01.369945 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:01.370407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:01.371137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:01.371597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:01.372022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:01.563512 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:01.571394 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-13738f84-5eb6-449e-bc35-f6e5b1841477 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1511 microversion: 2.1 time: 0.213561 Aug 23 08:24:01.571967 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 339/707] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:01 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:24:02.007534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-dd769bbf-8b44-47f5-8b6f-8daaedd66741 req-2a465b9a-feed-4b2a-a3fe-6c7f6ef9bebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "192c6788-aad3-4eed-a9bf-2b29cf744295", "name": "network-vif-deleted", "tag": "3f11dfe7-6852-4ec4-90f1-1be712701c18"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:24:02.017332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dd769bbf-8b44-47f5-8b6f-8daaedd66741 req-2a465b9a-feed-4b2a-a3fe-6c7f6ef9bebe service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:02.021392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dd769bbf-8b44-47f5-8b6f-8daaedd66741 req-2a465b9a-feed-4b2a-a3fe-6c7f6ef9bebe service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:02.021392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dd769bbf-8b44-47f5-8b6f-8daaedd66741 req-2a465b9a-feed-4b2a-a3fe-6c7f6ef9bebe service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:02.029900 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-dd769bbf-8b44-47f5-8b6f-8daaedd66741 req-2a465b9a-feed-4b2a-a3fe-6c7f6ef9bebe service nova] Creating event network-vif-deleted:3f11dfe7-6852-4ec4-90f1-1be712701c18 for instance 192c6788-aad3-4eed-a9bf-2b29cf744295 on hv-cinder-85407 Aug 23 08:24:02.034788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-dd769bbf-8b44-47f5-8b6f-8daaedd66741 req-2a465b9a-feed-4b2a-a3fe-6c7f6ef9bebe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031625 Aug 23 08:24:02.035480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 369/708] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:24:02.594576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:02.595211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:02.601615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:02.602099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:02.602535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:02.603260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:02.603714 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:02.604137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:02.637696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:02.638183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:02.638615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:02.639098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lazy-loading 'fault' on Instance uuid 192c6788-aad3-4eed-a9bf-2b29cf744295 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:24:02.679397 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a59ef94e054c3d8175e1c0f1ad783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee175b1f398844f6be0075d3e127e8b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:02.687002 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-814c853e-eef3-45cc-a3fe-8f1756f3b14a tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 200 len: 1308 microversion: 2.1 time: 0.096286 Aug 23 08:24:02.687560 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 340/709] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:02 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:24:03.709689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:03.710379 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] [instance: 192c6788-aad3-4eed-a9bf-2b29cf744295] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:03.716743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:03.717222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:03.717660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:03.718343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:03.718795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:03.719317 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:03.733140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] HTTP exception thrown: Instance 192c6788-aad3-4eed-a9bf-2b29cf744295 could not be found. Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Request method failure captured: Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 HTTP/1.1 Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI3pDt_G9QQ9Ifcm51xNzTXoFaecgXCU68EYbZZBxFxagbAT_BVMwVNY51QrMgU0FAzCOg_29r1HfiFkaBAf3pe8lg7W45-yR7TnhYNFwfTgm_a1ial8ssBpRQ0XGr4tMGnBoLJ8SKhjBKvOiPSvXjLLRwThJQUoN-0_GIzshvlE-8o Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: ee175b1f398844f6be0075d3e127e8b3 Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1767759879 Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:24:03.734882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee175b1f398844f6be0075d3e127e8b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee175b1f398844f6be0075d3e127e8b3", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee175b1f398844f6be0075d3e127e8b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee175b1f398844f6be0075d3e127e8b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-VolumesSnapshotTestJSON-1767759879 Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: ee175b1f398844f6be0075d3e127e8b3 Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1767759879 Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-VolumesSnapshotTestJSON-1767759879-project Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: a0a59ef94e054c3d8175e1c0f1ad783a Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-VolumesSnapshotTestJSON-1767759879-project Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 192c6788-aad3-4eed-a9bf-2b29cf744295 could not be found. Aug 23 08:24:03.736381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '192c6788-aad3-4eed-a9bf-2b29cf744295'} Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 192c6788-aad3-4eed-a9bf-2b29cf744295 could not be found. Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:24:03.737125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 192c6788-aad3-4eed-a9bf-2b29cf744295 could not be found. Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 192c6788-aad3-4eed-a9bf-2b29cf744295 could not be found. Aug 23 08:24:03.738612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:24:03.740249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] Returning 404 to user: Instance 192c6788-aad3-4eed-a9bf-2b29cf744295 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:24:03.740249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fcc84dcb-8379-4318-9c27-69f6cbd07c19 tempest-VolumesSnapshotTestJSON-1767759879 tempest-VolumesSnapshotTestJSON-1767759879-project] 10.222.0.58 "GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295" status: 404 len: 111 microversion: 2.1 time: 0.031294 Aug 23 08:24:03.740249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 370/710] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:03 2022] GET /compute/v2.1/servers/192c6788-aad3-4eed-a9bf-2b29cf744295 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:24:42.074668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:42.075352 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:42.077728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=13 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:42.078518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:42.088808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:42.091701 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:42.092244 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:42.094259 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:42.099624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:42.100269 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:42.143675 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-033cbb79-0d70-4b93-9a0c-797e22e16b39 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments/49d849da-4af2-4fe1-9884-f5bee871fd66" status: 200 len: 194 microversion: 2.20 time: 0.073439 Aug 23 08:24:42.144912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 341/711] 10.222.0.58 () {60 vars in 1454 bytes} [Tue Aug 23 08:24:42 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments/49d849da-4af2-4fe1-9884-f5bee871fd66 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:24:42.231441 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:42.231441 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:42.232029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:42.236171 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:42.243353 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:42.243861 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:42.244861 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:42.245582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:42.246092 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:42.246525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:42.379871 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lazy-loading 'services' on Instance uuid 895b9968-c8a0-4035-82f3-15a6726d65ed {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:24:42.627793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cd570f5f-dc83-4024-8879-58ed78b6d132 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "DELETE /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments/49d849da-4af2-4fe1-9884-f5bee871fd66" status: 202 len: 0 microversion: 2.20 time: 0.403840 Aug 23 08:24:42.628318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 371/712] 10.222.0.58 () {60 vars in 1457 bytes} [Tue Aug 23 08:24:42 2022] DELETE /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments/49d849da-4af2-4fe1-9884-f5bee871fd66 => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:24:42.637019 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:42.639343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:42.647593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:42.648082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:42.648544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:42.649246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:42.649705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:42.650143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:42.682305 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4d092e1e-b4bf-4852-a4b3-a7aad5ae98bc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049465 Aug 23 08:24:42.683115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 342/713] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Aug 23 08:24:42 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:24:43.697360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:43.701199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:43.707756 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:43.708324 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:43.708990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:43.709792 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:43.710434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:43.711100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:43.743293 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9ebefe98-34a2-4356-8baa-309b9f68838e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051055 Aug 23 08:24:43.744368 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 372/714] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Aug 23 08:24:43 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 08:24:44.762333 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:44.766152 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:44.774255 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:44.774751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:44.775262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:44.781404 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:44.782230 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:44.782861 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:44.816919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f6c2196d-04a5-45c9-8ba3-88f18212c0ec tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063991 Aug 23 08:24:44.823688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 343/715] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Aug 23 08:24:44 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:24:44.886378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:44.887187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:44.893457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:44.893931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:44.894458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:44.895119 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:44.895571 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:44.896318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:44.924230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:24:45.289510 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ec95efe3-378f-4401-8156-d507688ec9ed tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "DELETE /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 204 len: 0 microversion: 2.20 time: 0.403963 Aug 23 08:24:45.290431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 373/716] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Aug 23 08:24:44 2022] DELETE /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 08:24:45.299046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:45.305403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:45.307007 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:45.307704 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:45.308347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:45.309274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:45.309990 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:45.310600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:45.459645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:45.468460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:45.469955 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:45.471153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d69d64f3-d399-4caf-bdc8-27e6200e4c48 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.175956 Aug 23 08:24:45.471887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 344/717] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:45 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:24:46.494701 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:46.495804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:46.510001 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:46.516702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:46.516702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:46.516702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:46.516702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:46.517134 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:46.727669 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:46.739206 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:46.740822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:46.742189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-436448ee-5be1-49ca-93e3-a9ee8c49c825 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.252018 Aug 23 08:24:46.756192 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 374/718] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:46 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:24:47.769452 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:47.772336 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:47.789580 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:47.790078 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:47.791055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:47.791804 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:47.792298 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:47.793641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:48.115347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:48.126032 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:48.128721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:48.133163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-94497959-50e4-4bb4-bb82-e3b150697fb9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1723 microversion: 2.20 time: 0.369200 Aug 23 08:24:48.153180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 345/719] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:47 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:24:48.682328 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-ab59b18a-8f89-4d55-954c-a97276ef0e40 req-c92e39b6-bb97-4585-b5fb-9410a653979c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895b9968-c8a0-4035-82f3-15a6726d65ed", "name": "network-vif-deleted", "tag": "c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:24:48.692789 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ab59b18a-8f89-4d55-954c-a97276ef0e40 req-c92e39b6-bb97-4585-b5fb-9410a653979c service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:48.693241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ab59b18a-8f89-4d55-954c-a97276ef0e40 req-c92e39b6-bb97-4585-b5fb-9410a653979c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:48.693679 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ab59b18a-8f89-4d55-954c-a97276ef0e40 req-c92e39b6-bb97-4585-b5fb-9410a653979c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:48.712974 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-ab59b18a-8f89-4d55-954c-a97276ef0e40 req-c92e39b6-bb97-4585-b5fb-9410a653979c service nova] Creating event network-vif-deleted:c6a2ac6b-d534-4b57-a6f6-b5e1ea2f1097 for instance 895b9968-c8a0-4035-82f3-15a6726d65ed on hv-cinder-85407 Aug 23 08:24:48.724764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-ab59b18a-8f89-4d55-954c-a97276ef0e40 req-c92e39b6-bb97-4585-b5fb-9410a653979c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041019 Aug 23 08:24:48.724764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 375/720] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:24:49.162179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:49.163321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:49.171111 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:49.171916 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:49.172643 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:49.173650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:49.178916 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:49.179458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:49.221534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:49.222022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:49.222687 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:49.223372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lazy-loading 'fault' on Instance uuid 895b9968-c8a0-4035-82f3-15a6726d65ed {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:24:49.278163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:49.288351 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:49.290288 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:49.291738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1e82d412-3693-479b-b682-58439c748457 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 200 len: 1371 microversion: 2.20 time: 0.134273 Aug 23 08:24:49.307518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 346/721] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:49 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:24:49.526979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c3b6178b-35ae-4472-8b4a-c89b1eaae422 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Action: 'create', calling method: .version_select at 0x7fa61a108ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1879047049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILkLV6effbm4XHWU4wW2cgGUQzkFtJ5/gkd87tQTXTCm5s+ZJxx+cNDWZ0OeRQWg2cyRoAu0l74/4PSEWHPhUb8ABKtOxFa/qz13i7sS3RitbkpfHvs3PFZnlU/4nlSPg=="}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:24:49.547769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-c3b6178b-35ae-4472-8b4a-c89b1eaae422 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Getting quotas for project f80bce57227744ac9be2fda344a86e39. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:24:49.551930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-c3b6178b-35ae-4472-8b4a-c89b1eaae422 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Getting quotas for user ef9753669de440489453104bbe61b449 and project f80bce57227744ac9be2fda344a86e39. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:24:49.682318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c3b6178b-35ae-4472-8b4a-c89b1eaae422 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.360624 Aug 23 08:24:49.683762 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 376/722] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:24:49 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:24:50.322715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:50.324128 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:50.332533 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:50.334040 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:50.334725 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:50.335585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:50.336328 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:50.336859 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:50.359724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] HTTP exception thrown: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Request method failure captured: Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed HTTP/1.1 Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0FIHe0LkvA12I2JdjVdevptNjPU5DBpdwMEvseDqS0BPzVtt5Yr8g--yaD4yyghKXbsT7uJiyhveNGxp-ZMx3zPL1nnSOfP3yCtjvug2k6cyBtjVsAPJeC1jn4SraX9Dpud1ipUu5cRuEEEMA86Wy5Yunj7ttj4XGPvUhjQpEZW2s Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: bc3167dc177744959760f39d57937670 Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:24:50.361517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc3167dc177744959760f39d57937670", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc3167dc177744959760f39d57937670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: bc3167dc177744959760f39d57937670 Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: ce316aa5c0b54ac99ade6cc4163ee209 Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:24:50.363332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '895b9968-c8a0-4035-82f3-15a6726d65ed'} Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:24:50.364314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:24:50.366028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:24:50.367460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Returning 404 to user: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:24:50.367720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1d6e03e0-c585-46bf-801a-fda6f08c0234 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 404 len: 111 microversion: 2.20 time: 0.048608 Aug 23 08:24:50.368510 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 347/723] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:50 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:24:50.379882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0c5e2088-4344-4088-920e-9bec476f84f6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '.version_select at 0x7fa61e8df1f0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:50.459617 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0c5e2088-4344-4088-920e-9bec476f84f6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990101875" status: 204 len: 0 microversion: 2.20 time: 0.085212 Aug 23 08:24:50.460722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 377/724] 10.222.0.58 () {60 vars in 1262 bytes} [Tue Aug 23 08:24:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990101875 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 08:24:51.422196 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-399e2c20-a9a6-4744-b5d6-df74696cb65c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'create', calling method: .version_select at 0x7fa619f3a160>, body: {"keypair": {"name": "tempest-keypair-247155968", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmHvEghTgmgTlGYNzrUw6p8LhYxhL0JrOJVC/++tgR1BZnDNYgHiPz+ynlFUiUgr5io6J69anib8VkEbqGCPPs4wfmSXSf9qJ+KIvqiJND7dtua8N3JQIS1zTR8RktN9Q=="}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:24:51.438707 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-399e2c20-a9a6-4744-b5d6-df74696cb65c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Getting quotas for project bc3167dc177744959760f39d57937670. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:24:51.444858 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-399e2c20-a9a6-4744-b5d6-df74696cb65c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Getting quotas for user ce316aa5c0b54ac99ade6cc4163ee209 and project bc3167dc177744959760f39d57937670. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:24:51.556892 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-399e2c20-a9a6-4744-b5d6-df74696cb65c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.138670 Aug 23 08:24:51.557604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 348/725] 10.222.0.58 () {62 vars in 1200 bytes} [Tue Aug 23 08:24:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 140 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 08:24:52.402826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:24:52.406105 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:52.413377 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:52.413868 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:52.414296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:52.415199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:52.415654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:52.416069 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:52.708603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-75ac70ba-7661-4cc8-94ba-1e3ea46f09f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "POST /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/action" status: 202 len: 0 microversion: 2.1 time: 0.310225 Aug 23 08:24:52.709614 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 378/726] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:24:52 2022] POST /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:24:52.719478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:52.720091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:52.726319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:52.727103 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:52.727531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:52.728470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:52.728926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:52.729486 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:52.909756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:52.921666 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-423b4c3d-a539-4f08-9c4a-69606cf8f5ec tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1751 microversion: 2.1 time: 0.207142 Aug 23 08:24:52.934645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 349/727] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:52 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:24:53.947325 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:53.948015 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:53.954281 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:53.954839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:53.955301 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:53.956047 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:53.956437 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:53.956901 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:54.137608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:54.146822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6ab640bb-f6ca-4778-a68d-b7effb188a11 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.204503 Aug 23 08:24:54.147484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 379/728] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:53 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:24:54.485776 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-305260646", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09a6fa59-e4cc-4c76-8e34-2eaf4ca225a7"}], "security_groups": [{"name": "tempest-securitygroup--349333599"}], "key_name": "tempest-keypair-247155968", "user_data": "}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:24:54.601465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] validate_networks() for [('09a6fa59-e4cc-4c76-8e34-2eaf4ca225a7', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:24:55.067613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:24:55.068046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:24:55.068512 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:24:55.068919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:24:55.069324 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:24:55.078282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:55.078759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:55.079242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:55.079999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:55.080509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:55.080929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:55.098112 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Getting quotas for project bc3167dc177744959760f39d57937670. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:24:55.102189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Getting quotas for user ce316aa5c0b54ac99ade6cc4163ee209 and project bc3167dc177744959760f39d57937670. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:24:55.113506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:24:55.115777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:24:55.169861 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:55.170693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:55.179729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:55.180216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:55.180777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:55.181886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:55.182582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:55.183205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:55.260295 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b7c849d5-c897-471f-87f3-1cc9441a7c5b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.778639 Aug 23 08:24:55.261355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 350/729] 10.222.0.58 () {62 vars in 1188 bytes} [Tue Aug 23 08:24:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 23 08:24:55.274317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-980f5c98-e55e-4084-8df7-a5d2cbf4da42 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:55.274974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-980f5c98-e55e-4084-8df7-a5d2cbf4da42 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:55.348497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-980f5c98-e55e-4084-8df7-a5d2cbf4da42 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:55.357809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-980f5c98-e55e-4084-8df7-a5d2cbf4da42 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:55.359680 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-980f5c98-e55e-4084-8df7-a5d2cbf4da42 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:55.371124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-980f5c98-e55e-4084-8df7-a5d2cbf4da42 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1280 microversion: 2.20 time: 0.090616 Aug 23 08:24:55.371124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 351/730] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:55 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1280 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:24:55.371836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:55.379518 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7766bca7-9496-41c3-b3fc-32a7bb4bca6e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.213990 Aug 23 08:24:55.380132 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 380/731] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:55 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:24:56.384869 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:56.385423 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:56.392139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:56.392733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:56.393170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:56.394005 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:56.394301 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:56.394720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:56.401514 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:56.404330 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:56.409057 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:56.409536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:56.409968 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:56.410655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:56.411136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:56.411559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:56.490086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:56.498319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:56.500076 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:56.501366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3a22be1e-5549-47eb-9172-a87e6d8dc342 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1284 microversion: 2.20 time: 0.120740 Aug 23 08:24:56.502078 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 352/732] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:56 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:24:56.589750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:56.598669 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e114f001-c788-4bd0-81d2-3881a0ef657a tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.200932 Aug 23 08:24:56.599279 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 381/733] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:56 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:24:57.525092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:57.525690 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:57.532652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:57.533128 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:57.533557 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:57.534314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:57.534764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:57.535239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:57.599630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:57.607975 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:57.610518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:57.610659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8b0d4918-9a3d-46c8-b5fc-10c3389c9599 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1332 microversion: 2.20 time: 0.089535 Aug 23 08:24:57.611245 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 353/734] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:57 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:24:57.621436 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:57.622064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:57.628802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:57.631481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:57.631481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:57.631481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:57.631481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:57.631893 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:57.818495 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:57.829156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-dabf5277-7d32-459a-850a-43f88505f092 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.211473 Aug 23 08:24:57.832249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 382/735] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:57 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:24:57.876214 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:57.876814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:57.882898 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:57.883534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:57.884035 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:57.884802 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:57.885321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:57.885808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:57.977715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lazy-loading 'services' on Instance uuid 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:24:58.218706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e6601735-263c-4c5f-8645-c447391d829e tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments/5933d394-dffd-48cd-aa0b-da146aca8069" status: 202 len: 0 microversion: 2.1 time: 0.346467 Aug 23 08:24:58.219334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 354/736] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:24:57 2022] DELETE /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments/5933d394-dffd-48cd-aa0b-da146aca8069 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:24:58.227693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:58.229910 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:58.235855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:58.237937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:58.237937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:58.237937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:58.237937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:58.238508 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:58.268648 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-699439f5-257f-46b8-bee0-e1bbac919d93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Aug 23 08:24:58.269213 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 383/737] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:24:58 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:24:58.633519 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:58.634128 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:58.641506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:58.641994 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:58.642427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:58.643153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:58.643605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:58.644029 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:58.851383 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:58.852008 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:58.859505 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:58.859955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:58.860399 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:58.861118 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:58.861580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:58.862019 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:58.878452 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:58.888804 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:58.890844 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:58.892392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-648f20b9-5249-4781-8ad4-3417e26ba76c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.263164 Aug 23 08:24:58.892964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 355/738] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:58 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:24:59.022041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:24:59.031378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-156067c7-41fc-4db6-91cf-c2467dc8c48e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.183684 Aug 23 08:24:59.031891 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 384/739] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:24:58 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:24:59.282532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:59.286037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:59.293417 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:59.295508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:59.295508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:59.296183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:59.296740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:59.297175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:59.331861 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-199d4abd-2b10-43f1-b31a-b265d9de7c1d tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054826 Aug 23 08:24:59.332760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 356/740] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:24:59 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:24:59.976972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:24:59.976972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:24:59.976972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=4 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:24:59.976972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:59.976972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:59.977943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:24:59.977943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:24:59.977943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:24:59.977943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.053120 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:00.053737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:00.061098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.061243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.061596 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.062275 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.062745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.063238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.101200 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:00.107269 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:00.108780 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:00.109876 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b25a2b15-d6fe-4615-85e7-f63a24281eb7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.197940 Aug 23 08:25:00.110435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 385/741] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:24:59 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:00.125886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-ba727c08-1ce1-4a6b-b245-f72513c0cd95 req-1e2a98c0-cc69-4861-bfc5-fd74bbf6ad41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c", "tag": "8e36973f-5869-4694-b64a-1171d88a8a97"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:00.135730 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ba727c08-1ce1-4a6b-b245-f72513c0cd95 req-1e2a98c0-cc69-4861-bfc5-fd74bbf6ad41 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.136214 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ba727c08-1ce1-4a6b-b245-f72513c0cd95 req-1e2a98c0-cc69-4861-bfc5-fd74bbf6ad41 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.136763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-ba727c08-1ce1-4a6b-b245-f72513c0cd95 req-1e2a98c0-cc69-4861-bfc5-fd74bbf6ad41 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.148448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-ba727c08-1ce1-4a6b-b245-f72513c0cd95 req-1e2a98c0-cc69-4861-bfc5-fd74bbf6ad41 service nova] Creating event network-changed:8e36973f-5869-4694-b64a-1171d88a8a97 for instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c on hv-cinder-85407 Aug 23 08:25:00.157779 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-ba727c08-1ce1-4a6b-b245-f72513c0cd95 req-1e2a98c0-cc69-4861-bfc5-fd74bbf6ad41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046139 Aug 23 08:25:00.158551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 386/742] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:00.280137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:00.288581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-79a15901-4559-464c-b464-58d7d57c48c5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.239659 Aug 23 08:25:00.289146 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 357/743] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:00 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:25:00.345321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:00.347599 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:00.354729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.355279 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.355687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.356392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.356838 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.357299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.374044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:00.387515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2a72356e-ab45-4292-a93a-ad29eb649f16 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046973 Aug 23 08:25:00.388087 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 387/744] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:25:00 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:25:00.468653 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:00.469150 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:00.475990 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.476821 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.477491 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.478211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.478843 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.479486 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.505125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:25:00.543584 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:00.806074 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bdc85e33-dea8-4185-bae2-d6c5ee88ad3f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 204 len: 0 microversion: 2.1 time: 0.336848 Aug 23 08:25:00.806074 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 358/745] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:25:00 2022] DELETE /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:25:00.811392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:00.812081 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:00.820911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.821400 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.821835 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.822548 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:00.823036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:00.823528 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:00.955996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:00.963994 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7d4ad2fe-03fe-428a-b149-607f15e7dd14 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1688 microversion: 2.1 time: 0.157641 Aug 23 08:25:00.964561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 388/746] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:00 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:01.132362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:01.132974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:01.140304 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:01.140800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:01.141244 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:01.141960 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:01.142518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:01.142964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:01.275541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:01.284289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:01.285812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:01.286913 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-de7db220-f328-491d-a822-f15e142a06f1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.158908 Aug 23 08:25:01.287523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 359/747] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:01 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:01.310251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:01.310865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:01.316857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:01.317344 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:01.317781 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:01.318469 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:01.318925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:01.319372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:01.469682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:01.477804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-75ffc108-0b48-41cc-b252-d1e980534b3d tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.171494 Aug 23 08:25:01.478358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 389/748] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:01 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:25:01.985506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:01.986144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:01.992074 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:01.992557 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:01.992998 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:01.993696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:01.994137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:01.994560 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:02.123040 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:02.133033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-71ce21ee-cd32-4633-9670-6a99b20b1921 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1688 microversion: 2.1 time: 0.151229 Aug 23 08:25:02.133784 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 360/749] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:01 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:02.312150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:02.312788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:02.319132 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:02.319621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:02.320314 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:02.321008 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:02.321467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:02.321947 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:02.454175 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:02.463516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:02.465309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:02.466533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c053f399-2dc9-4b03-a93d-dce6a876360f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.158213 Aug 23 08:25:02.467863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 390/750] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:02 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:02.498840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:02.499528 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:02.505917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:02.506394 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:02.506824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:02.507540 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:02.507994 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:02.508412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:02.654129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:02.663322 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-632f0abf-f637-4f50-81ff-90969bdc1a1c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.168366 Aug 23 08:25:02.663884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 361/751] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:02 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:03.154695 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:03.155342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:03.161199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:03.161670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:03.162097 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:03.162768 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:03.163244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:03.163663 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:03.297105 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:03.304591 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2323679b-1dd4-4dce-9242-f85cd0eb1564 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1688 microversion: 2.1 time: 0.153737 Aug 23 08:25:03.305222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 391/752] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:03 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:03.490012 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:03.490667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:03.497318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:03.497818 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:03.498263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:03.499559 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:03.500022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:03.500447 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:03.632875 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:03.641469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:03.643101 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:03.644334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c360e03e-4287-431b-baef-4b1b82d78e46 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.158176 Aug 23 08:25:03.644858 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 362/753] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:03 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:03.684457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:03.685072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:03.691395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:03.699215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:03.699215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:03.699215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:03.699215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:03.699613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:03.843465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:03.860687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-64da7160-edac-4fc2-a6c0-bb1e2e7cd4f4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.180006 Aug 23 08:25:03.861312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 392/754] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:03 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:04.327248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:04.327976 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:04.333811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:04.334290 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:04.334718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:04.335423 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:04.335874 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:04.336290 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:04.491110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:04.499354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9131cb08-71bb-4d39-93f9-54af0487f2fd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1688 microversion: 2.1 time: 0.175965 Aug 23 08:25:04.499923 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 363/755] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:04 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:04.666935 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:04.667585 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:04.673460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:04.673936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:04.674370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:04.675082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:04.675538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:04.675958 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:04.806666 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:04.815412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:04.816912 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:04.818010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e7eec71f-0986-4376-9dfb-5f3c72c06941 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.155005 Aug 23 08:25:04.818559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 393/756] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:04 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:04.881402 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:04.882039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:04.888359 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:04.890739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:04.890739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:04.890739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:04.890739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:04.891229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:05.027362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:05.035523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b203876f-1164-490f-9663-edd331a4285c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.157935 Aug 23 08:25:05.036088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 364/757] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:04 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:05.520113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:05.520715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:05.526593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:05.527111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:05.527549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:05.528228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:05.528673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:05.529088 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:05.661637 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:05.669396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-840e8e0e-2b5a-4a9c-87d7-2a7cfa82b91a tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1688 microversion: 2.1 time: 0.153107 Aug 23 08:25:05.673972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 394/758] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:05 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:05.841266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:05.841882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:05.843849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:05.844531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=12 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:05.849306 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:05.849853 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:05.850293 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:05.851009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:05.851469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:05.851920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:05.982564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:05.991342 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:05.992835 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:05.993922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-36147206-1459-401d-b472-7ca6769640b5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.156715 Aug 23 08:25:05.994479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 365/759] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:05 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:06.056646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:06.057253 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:06.064277 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:06.064751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:06.065182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:06.065857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:06.066307 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:06.066725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:06.206264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:06.214584 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7c57148d-b4c7-4afd-a738-15fb4c001271 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.161982 Aug 23 08:25:06.215171 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 395/760] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:06 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:06.690478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:06.691114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:06.697271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:06.697749 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:06.698174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:06.698849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:06.699332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:06.699752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:06.828002 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:06.835630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d7fc6d68-858e-4c08-9ed6-8d05c1c10ad0 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1688 microversion: 2.1 time: 0.148970 Aug 23 08:25:06.836269 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 366/761] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:06 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:07.017530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:07.018141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:07.024114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:07.024603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:07.025105 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:07.025803 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:07.026259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:07.026688 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:07.153027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:07.161818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:07.163366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:07.164468 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-dd93cb71-4370-4923-996d-8b7e12506ae0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.151518 Aug 23 08:25:07.165026 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 396/762] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:07 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:07.235345 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:07.235951 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:07.242179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:07.242653 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:07.243115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:07.243790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:07.244237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:07.244654 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:07.390136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:07.398357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7bf7b72a-69ee-4703-8951-0ca7733332f7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.166893 Aug 23 08:25:07.398930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 367/763] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:07 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:07.857474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:07.858167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:07.864497 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:07.864978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:07.865412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:07.866092 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:07.866549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:07.867008 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:08.072227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:08.081007 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bd9a42c5-df2a-4450-b12c-a8dc54debf76 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1688 microversion: 2.1 time: 0.226983 Aug 23 08:25:08.094210 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 397/764] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:07 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1688 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:08.187009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:08.187915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:08.194071 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:08.194683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:08.195631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:08.196639 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:08.197361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:08.197999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:08.420090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:08.421919 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:08.428351 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:08.429263 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:08.429705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:08.430487 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:08.431286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:08.431920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:08.445659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:08.455915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:08.457926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:08.459752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0ea1bfa3-e9a1-471c-ab98-e1e773d57598 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.276872 Aug 23 08:25:08.467856 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 368/765] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:08 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:08.685962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:08.694596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-90c2f8cd-74ea-4b8c-9562-5a530dbc933f tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.278815 Aug 23 08:25:08.695448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 398/766] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:08 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:25:09.069451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-e17b34e3-0f2e-4584-9cfa-c70d1ddf377f req-e06f48ec-69ec-4873-96b4-ebcc38754770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3184a3f4-7eb5-47f7-8cf6-74e4848f11dd", "name": "network-vif-deleted", "tag": "d0bb753d-02ab-4eee-bd85-09531cfa16df"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:09.079542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-e17b34e3-0f2e-4584-9cfa-c70d1ddf377f req-e06f48ec-69ec-4873-96b4-ebcc38754770 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:09.080021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-e17b34e3-0f2e-4584-9cfa-c70d1ddf377f req-e06f48ec-69ec-4873-96b4-ebcc38754770 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:09.080452 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-e17b34e3-0f2e-4584-9cfa-c70d1ddf377f req-e06f48ec-69ec-4873-96b4-ebcc38754770 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:09.092072 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-e17b34e3-0f2e-4584-9cfa-c70d1ddf377f req-e06f48ec-69ec-4873-96b4-ebcc38754770 service nova] Creating event network-vif-deleted:d0bb753d-02ab-4eee-bd85-09531cfa16df for instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd on hv-cinder-85407 Aug 23 08:25:09.099204 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-e17b34e3-0f2e-4584-9cfa-c70d1ddf377f req-e06f48ec-69ec-4873-96b4-ebcc38754770 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033087 Aug 23 08:25:09.100086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 369/767] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:09.103773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:09.104420 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:09.110506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:09.111004 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:09.124196 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:09.125014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:09.125672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:09.126253 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:09.223002 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:09.231719 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3a8b4771-325e-4a6a-9363-7818592bd720 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1621 microversion: 2.1 time: 0.133583 Aug 23 08:25:09.243048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 399/768] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:09 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1621 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:09.483923 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:09.484715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:09.490956 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:09.491670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:09.492161 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:09.492861 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:09.493319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:09.493951 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:09.626800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:09.635788 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:09.637439 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:09.638581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b946af67-cac4-431e-ba3a-f13656c18a84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.160235 Aug 23 08:25:09.653724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 370/769] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:09 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:09.715892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:09.716498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:09.722317 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:09.722795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:09.723252 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:09.723932 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:09.724378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:09.724789 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:09.872138 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:09.881741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e6977a1b-9527-40c4-b900-1ce4969e45d4 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1756 microversion: 2.1 time: 0.169579 Aug 23 08:25:09.882309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 400/770] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:09 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:10.255270 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:10.256076 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:10.262197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:10.262705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:10.263183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:10.266709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:10.266709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:10.266709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:10.293219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:10.297130 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:10.297643 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:10.301127 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:10.301127 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lazy-loading 'fault' on Instance uuid 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:25:10.339995 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:10.348504 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d4dad917-de49-4789-a92a-b5171d0c8cf5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 200 len: 1335 microversion: 2.1 time: 0.097211 Aug 23 08:25:10.349075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 371/771] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:10 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:10.655514 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-1d73cf48-4f94-4908-b5e5-9a026f4d501d req-44bd05d1-df33-4648-b942-0f8a03a8f68d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c", "name": "network-vif-plugged", "status": "completed", "tag": "8e36973f-5869-4694-b64a-1171d88a8a97"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:10.661807 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:10.662618 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:10.666363 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-1d73cf48-4f94-4908-b5e5-9a026f4d501d req-44bd05d1-df33-4648-b942-0f8a03a8f68d service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:10.667062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-1d73cf48-4f94-4908-b5e5-9a026f4d501d req-44bd05d1-df33-4648-b942-0f8a03a8f68d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:10.667493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-1d73cf48-4f94-4908-b5e5-9a026f4d501d req-44bd05d1-df33-4648-b942-0f8a03a8f68d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:10.669991 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:10.671231 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:10.671835 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:10.672562 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:10.673672 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:10.674108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:10.679904 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-1d73cf48-4f94-4908-b5e5-9a026f4d501d req-44bd05d1-df33-4648-b942-0f8a03a8f68d service nova] Creating event network-vif-plugged:8e36973f-5869-4694-b64a-1171d88a8a97 for instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c on hv-cinder-85407 Aug 23 08:25:10.685105 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-1d73cf48-4f94-4908-b5e5-9a026f4d501d req-44bd05d1-df33-4648-b942-0f8a03a8f68d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033822 Aug 23 08:25:10.686013 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 401/772] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:10.830083 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:10.838559 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:10.840156 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:10.841261 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d0ac5a2c-d335-4514-99ef-8a90ff18dedb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.184425 Aug 23 08:25:10.841820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 372/773] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:10 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:25:10.903773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:10.904459 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:10.911815 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:10.912275 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:10.912704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:10.913390 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:10.913838 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:10.914257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:11.057149 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:11.066161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-251db06f-1b5c-4e3d-81ea-67e237bf112c tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1759 microversion: 2.1 time: 0.166751 Aug 23 08:25:11.066725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 402/774] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:10 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:11.369470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:11.370039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:11.377075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:11.377561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:11.378001 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:11.378691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:11.379186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:11.379615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:11.393974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] HTTP exception thrown: Instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd could not be found. Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Request method failure captured: Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd HTTP/1.1 Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0BCWc2oRmFZ1_zUztLlLniSOHZHpEyOoVAXyhpSePuz5nzpZ6FXuN3fD3VReZe3nNTxgolkDgsAp1R3ShC1Ys-yJhdYL5m_4hgDoT1V9fakcuefZXvA-rn6Alpx9Pv-1WWTWriqZTXJDyjo-_jIbZPcNCVMRv7q8bknNFyG3yxtEc Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:25:11.395640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cfd891d8d1b7436fabfa2c48019c3565", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: b3c984088c0448f8abc0a0b60b820b3e Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd could not be found. Aug 23 08:25:11.397509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '3184a3f4-7eb5-47f7-8cf6-74e4848f11dd'} Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd could not be found. Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:25:11.398353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd could not be found. Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd could not be found. Aug 23 08:25:11.399789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:11.401076 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Returning 404 to user: Instance 3184a3f4-7eb5-47f7-8cf6-74e4848f11dd could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:25:11.401076 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5a88b0e4-8b09-47d3-a5f6-5365c6f5e8cd tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd" status: 404 len: 111 microversion: 2.1 time: 0.031583 Aug 23 08:25:11.401076 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 373/775] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:11 2022] GET /compute/v2.1/servers/3184a3f4-7eb5-47f7-8cf6-74e4848f11dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:25:11.405709 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b67c4b90-3585-441e-b63a-c839f0f02004 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '.version_select at 0x7fa619f1ee50>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:11.505366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b67c4b90-3585-441e-b63a-c839f0f02004 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-603003347" status: 202 len: 0 microversion: 2.1 time: 0.103406 Aug 23 08:25:11.505943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 403/776] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Aug 23 08:25:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-603003347 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:25:11.864099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:11.864824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:11.871241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:11.871729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:11.872174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:11.872863 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:11.873325 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:11.874326 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:12.004631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:12.012917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:12.014490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:12.015640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9e267093-3321-4a51-b4c4-db8f7dd9cdf8 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.155482 Aug 23 08:25:12.016199 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 374/777] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:11 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:13.038365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:13.039041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:13.042043 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:13.045513 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:13.045984 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:13.046414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:13.047139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:13.047576 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:13.047995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:13.179038 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:13.187083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:13.188589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:13.189688 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-698c2bce-cebe-43ac-bc79-66ba0c78a88f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1405 microversion: 2.20 time: 0.155971 Aug 23 08:25:13.190246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 404/778] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:13 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:14.212389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:14.212993 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:14.219839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:14.220317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:14.220748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:14.221433 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:14.221911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:14.222330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:14.349596 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:14.353355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:14.358237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:14.360369 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:14.361522 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-734af544-d0d6-42eb-ba13-f224638d2fce tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1597 microversion: 2.20 time: 0.153033 Aug 23 08:25:14.362073 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 375/779] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:25:14 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1597 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:25:14.382891 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:14.383412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:14.390902 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:14.391404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:14.391842 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:14.392533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:14.392985 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:14.393408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:14.470650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-15586425-3a80-40fc-b425-570824c746f4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091638 Aug 23 08:25:14.471279 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 405/780] 10.222.0.58 () {60 vars in 1316 bytes} [Tue Aug 23 08:25:14 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:25:15.215519 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:15.216737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:15.225527 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:15.226081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:15.226588 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:15.227393 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:15.236107 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:15.236107 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:15.254928 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:25:15.663421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-de34541e-f1e6-41f1-8ff3-524db6e98a93 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "DELETE /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 204 len: 0 microversion: 2.1 time: 0.451312 Aug 23 08:25:15.664013 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 376/781] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:25:15 2022] DELETE /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:25:15.672980 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:15.673589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:15.679843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:15.680334 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:15.680805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:15.681620 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:15.682086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:15.682530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:15.686706 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=100 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:15.772772 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-d9130715-8564-42c1-8c22-ecc243b21658 req-4df9ccb7-8a94-43f9-b8f9-00b6f378d39d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c", "tag": "8e36973f-5869-4694-b64a-1171d88a8a97"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:15.796319 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d9130715-8564-42c1-8c22-ecc243b21658 req-4df9ccb7-8a94-43f9-b8f9-00b6f378d39d service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:15.797089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d9130715-8564-42c1-8c22-ecc243b21658 req-4df9ccb7-8a94-43f9-b8f9-00b6f378d39d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:15.797727 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d9130715-8564-42c1-8c22-ecc243b21658 req-4df9ccb7-8a94-43f9-b8f9-00b6f378d39d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:15.809956 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-d9130715-8564-42c1-8c22-ecc243b21658 req-4df9ccb7-8a94-43f9-b8f9-00b6f378d39d service nova] Creating event network-changed:8e36973f-5869-4694-b64a-1171d88a8a97 for instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c on hv-cinder-85407 Aug 23 08:25:15.815526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-d9130715-8564-42c1-8c22-ecc243b21658 req-4df9ccb7-8a94-43f9-b8f9-00b6f378d39d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053116 Aug 23 08:25:15.816420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 377/782] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:15.843836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:15.851678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-07b65ed8-accd-4340-917e-adccc2d15d38 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1509 microversion: 2.1 time: 0.183337 Aug 23 08:25:15.852239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 406/783] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:15 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:25:16.030950 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1771837174", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1879047049", "security_groups": [{"name": "tempest-secgroup-smoke-111967105"}], "networks": [{"uuid": "1371af8b-4ba3-4c99-85c5-74c593b9b8ee"}], "block_device_mapping_v2": [{"uuid": "e723e1b1-8d48-4dd5-be1a-604fa405c61a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:16.196677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] validate_networks() for [('1371af8b-4ba3-4c99-85c5-74c593b9b8ee', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:25:16.739155 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:25:16.740565 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:25:16.741237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:25:16.741767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:25:16.742294 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:25:16.756023 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:16.756900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:16.757611 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:16.758653 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:16.759526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:16.760209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:16.787258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Getting quotas for project f80bce57227744ac9be2fda344a86e39. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:25:16.791532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Getting quotas for user ef9753669de440489453104bbe61b449 and project f80bce57227744ac9be2fda344a86e39. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:25:16.861515 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:25:16.863968 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e723e1b1-8d48-4dd5-be1a-604fa405c61a',volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:25:16.875089 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:16.877143 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:16.890279 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:16.891809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:16.894634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:16.895840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:16.896590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:16.897262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:17.036307 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:17.051205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-41166b2a-e11e-4f29-bdef-79d82e973dcb tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1509 microversion: 2.1 time: 0.177758 Aug 23 08:25:17.051205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 407/784] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:16 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:17.361025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-33c88673-610e-4ced-95f8-1a5f05e623b3 req-767906f2-210e-4b3a-b477-3348bdf7a5a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017c13ab-2fa1-46f8-bab7-1308c79c41b0", "name": "network-vif-deleted", "tag": "edd2fddc-c817-4def-b863-9892d76cc2ad"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:17.370806 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-33c88673-610e-4ced-95f8-1a5f05e623b3 req-767906f2-210e-4b3a-b477-3348bdf7a5a4 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:17.371308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-33c88673-610e-4ced-95f8-1a5f05e623b3 req-767906f2-210e-4b3a-b477-3348bdf7a5a4 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:17.371742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-33c88673-610e-4ced-95f8-1a5f05e623b3 req-767906f2-210e-4b3a-b477-3348bdf7a5a4 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:17.382509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-33c88673-610e-4ced-95f8-1a5f05e623b3 req-767906f2-210e-4b3a-b477-3348bdf7a5a4 service nova] Creating event network-vif-deleted:edd2fddc-c817-4def-b863-9892d76cc2ad for instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 on hv-cinder-85407 Aug 23 08:25:17.387573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-33c88673-610e-4ced-95f8-1a5f05e623b3 req-767906f2-210e-4b3a-b477-3348bdf7a5a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124989 Aug 23 08:25:17.388191 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 408/785] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:17.695213 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-982c5ad5-c2fd-4ae7-8afb-f3ebf4edb904 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.668766 Aug 23 08:25:17.696120 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 378/786] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:25:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 08:25:17.708036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-357ce3fa-494a-44b5-b083-77093b4628dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:17.709015 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-357ce3fa-494a-44b5-b083-77093b4628dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:17.771903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-357ce3fa-494a-44b5-b083-77093b4628dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:17.785649 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-357ce3fa-494a-44b5-b083-77093b4628dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1089 microversion: 2.1 time: 0.081867 Aug 23 08:25:17.786237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 409/787] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:17 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:18.070538 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:18.071445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:18.077805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:18.080981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:18.080981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:18.080981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:18.080981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:18.081430 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:18.111708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:18.112195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:18.112662 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:18.113148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lazy-loading 'fault' on Instance uuid 017c13ab-2fa1-46f8-bab7-1308c79c41b0 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:25:18.158854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:18.166692 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6760765a-8099-4d6f-aa6c-203acde9c25f tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 200 len: 1312 microversion: 2.1 time: 0.101281 Aug 23 08:25:18.170618 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 379/788] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:18 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:18.806978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dc04c5d5-430e-441f-a5ef-28911963781a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:18.807586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-dc04c5d5-430e-441f-a5ef-28911963781a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:18.862081 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-dc04c5d5-430e-441f-a5ef-28911963781a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:18.869937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-dc04c5d5-430e-441f-a5ef-28911963781a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1089 microversion: 2.1 time: 0.066744 Aug 23 08:25:18.870520 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 410/789] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:18 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:19.186782 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:19.187446 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: 017c13ab-2fa1-46f8-bab7-1308c79c41b0] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:19.193885 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:19.194360 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:19.194832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:19.195520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:19.196225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:19.196648 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:19.210181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] HTTP exception thrown: Instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 could not be found. Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Request method failure captured: Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 HTTP/1.1 Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0BCWc2oRmFZ1_zUztLlLniSOHZHpEyOoVAXyhpSePuz5nzpZ6FXuN3fD3VReZe3nNTxgolkDgsAp1R3ShC1Ys-yJhdYL5m_4hgDoT1V9fakcuefZXvA-rn6Alpx9Pv-1WWTWriqZTXJDyjo-_jIbZPcNCVMRv7q8bknNFyG3yxtEc Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:25:19.211793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cfd891d8d1b7436fabfa2c48019c3565", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: b3c984088c0448f8abc0a0b60b820b3e Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 could not be found. Aug 23 08:25:19.213421 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '017c13ab-2fa1-46f8-bab7-1308c79c41b0'} Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 could not be found. Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:25:19.214407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 could not be found. Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 could not be found. Aug 23 08:25:19.215984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:19.217331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Returning 404 to user: Instance 017c13ab-2fa1-46f8-bab7-1308c79c41b0 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:25:19.217331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-15db55e6-09a6-4a72-ba2a-33a1497ca246 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0" status: 404 len: 111 microversion: 2.1 time: 0.030234 Aug 23 08:25:19.217331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 380/790] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:19 2022] GET /compute/v2.1/servers/017c13ab-2fa1-46f8-bab7-1308c79c41b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:25:19.222072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:19.222561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:19.228590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:19.229048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:19.229479 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:19.230159 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:19.230622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:19.231048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:19.254987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:25:19.607489 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-53525b33-3376-4efe-bad1-3ec101a1887b tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 204 len: 0 microversion: 2.1 time: 0.389427 Aug 23 08:25:19.608085 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 411/791] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:25:19 2022] DELETE /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:25:19.616611 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:19.617216 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:19.623133 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:19.623610 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:19.624038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:19.624712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:19.625163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:19.625604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:19.757177 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:19.765045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-fbbb2775-4dd3-4890-b8fd-f7ec8db736f6 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.152143 Aug 23 08:25:19.765607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 381/792] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:19 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:19.891630 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:19.892356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:19.898694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:19.908628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:19.908628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:19.908628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:19.908628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:19.909018 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:19.963245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:19.971010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f066322d-ee03-4bad-87b7-61dce21ee41b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1139 microversion: 2.1 time: 0.084069 Aug 23 08:25:19.971574 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 412/793] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:19 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:20.785737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:20.786356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:20.792702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:20.793223 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:20.793668 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:20.794368 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:20.795038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:20.795640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:20.928308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:20.936199 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d9194bb9-bffe-452d-a971-3b4413dc7850 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1522 microversion: 2.1 time: 0.154313 Aug 23 08:25:20.936774 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 382/794] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:20 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:20.993215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:20.993848 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:21.002780 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:21.003385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:21.003829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:21.004769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:21.005410 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:21.006478 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:21.015411 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-d4f05d44-ccf7-44d1-8ab7-f9fcfee80bad req-99a63681-51b1-4bcc-a19c-9067d0e9471f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb12ae3d-e305-4628-a89c-7a6f95c07fa8", "name": "network-vif-deleted", "tag": "a1092aaf-fd40-4484-a5b6-c54eedb226c8"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:21.025238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d4f05d44-ccf7-44d1-8ab7-f9fcfee80bad req-99a63681-51b1-4bcc-a19c-9067d0e9471f service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:21.025727 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d4f05d44-ccf7-44d1-8ab7-f9fcfee80bad req-99a63681-51b1-4bcc-a19c-9067d0e9471f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:21.026195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d4f05d44-ccf7-44d1-8ab7-f9fcfee80bad req-99a63681-51b1-4bcc-a19c-9067d0e9471f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:21.039832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-d4f05d44-ccf7-44d1-8ab7-f9fcfee80bad req-99a63681-51b1-4bcc-a19c-9067d0e9471f service nova] Creating event network-vif-deleted:a1092aaf-fd40-4484-a5b6-c54eedb226c8 for instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 on hv-cinder-85407 Aug 23 08:25:21.044761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-d4f05d44-ccf7-44d1-8ab7-f9fcfee80bad req-99a63681-51b1-4bcc-a19c-9067d0e9471f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033251 Aug 23 08:25:21.045349 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 383/795] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:21.080083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:21.088603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8c537640-ebb4-49b6-af90-b6a9b978037a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1139 microversion: 2.1 time: 0.099421 Aug 23 08:25:21.089549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 413/796] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:20 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1139 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:21.958625 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:21.959361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:21.965580 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:21.971839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:21.971839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:21.971839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:21.971839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:21.972216 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:21.999462 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:21.999880 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:22.000322 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:22.001331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lazy-loading 'fault' on Instance uuid bb12ae3d-e305-4628-a89c-7a6f95c07fa8 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:25:22.042974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3c984088c0448f8abc0a0b60b820b3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd891d8d1b7436fabfa2c48019c3565', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:22.051347 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bf2126b1-7bc0-4dac-8655-1ea9792ac5f5 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 200 len: 1312 microversion: 2.1 time: 0.098053 Aug 23 08:25:22.051920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 384/797] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:21 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:22.110305 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:22.111524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:22.118099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:22.118921 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:22.119564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:22.121782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:22.122406 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:22.123042 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:22.190419 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:22.198569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-46355b45-3f3c-4d1c-9483-8a743c42a567 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1187 microversion: 2.1 time: 0.092696 Aug 23 08:25:22.199163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 414/798] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:22 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:23.073511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:23.074217 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] [instance: bb12ae3d-e305-4628-a89c-7a6f95c07fa8] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:23.081260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:23.081774 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:23.082203 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:23.082926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:23.083412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:23.083835 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:23.097039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] HTTP exception thrown: Instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 could not be found. Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Request method failure captured: Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 HTTP/1.1 Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0BCWc2oRmFZ1_zUztLlLniSOHZHpEyOoVAXyhpSePuz5nzpZ6FXuN3fD3VReZe3nNTxgolkDgsAp1R3ShC1Ys-yJhdYL5m_4hgDoT1V9fakcuefZXvA-rn6Alpx9Pv-1WWTWriqZTXJDyjo-_jIbZPcNCVMRv7q8bknNFyG3yxtEc Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:25:23.098667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cfd891d8d1b7436fabfa2c48019c3565", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cfd891d8d1b7436fabfa2c48019c3565"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: cfd891d8d1b7436fabfa2c48019c3565 Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1156685148 Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: b3c984088c0448f8abc0a0b60b820b3e Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1156685148-project Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 could not be found. Aug 23 08:25:23.100287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'bb12ae3d-e305-4628-a89c-7a6f95c07fa8'} Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 could not be found. Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:25:23.101323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 could not be found. Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 could not be found. Aug 23 08:25:23.102814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:25:23.104263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] Returning 404 to user: Instance bb12ae3d-e305-4628-a89c-7a6f95c07fa8 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:25:23.104263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d9306907-3c3a-488e-a88c-0c459fd15a74 tempest-ServerRescueNegativeTestJSON-1156685148 tempest-ServerRescueNegativeTestJSON-1156685148-project] 10.222.0.58 "GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8" status: 404 len: 111 microversion: 2.1 time: 0.030711 Aug 23 08:25:23.104263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 385/799] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:23 2022] GET /compute/v2.1/servers/bb12ae3d-e305-4628-a89c-7a6f95c07fa8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:25:23.220010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:23.223075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:23.227384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:23.227958 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:23.228301 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:23.229006 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:23.229463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:23.229889 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:23.476484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:23.484380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6df5064e-df9f-439f-9175-bf13767a3b5b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1272 microversion: 2.1 time: 0.268368 Aug 23 08:25:23.484948 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 415/800] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:23 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:24.256391 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-f29d4575-474d-49e3-8419-756686abe70f req-4cd47e59-3d0f-44d4-8edc-99d5a41b280a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50f4b20-cc8e-40bf-925f-823811815d70", "tag": "12c59a69-5657-4426-9266-ea6ab28bbd96"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:24.266186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f29d4575-474d-49e3-8419-756686abe70f req-4cd47e59-3d0f-44d4-8edc-99d5a41b280a service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:24.267207 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f29d4575-474d-49e3-8419-756686abe70f req-4cd47e59-3d0f-44d4-8edc-99d5a41b280a service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:24.267751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f29d4575-474d-49e3-8419-756686abe70f req-4cd47e59-3d0f-44d4-8edc-99d5a41b280a service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:24.286244 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-f29d4575-474d-49e3-8419-756686abe70f req-4cd47e59-3d0f-44d4-8edc-99d5a41b280a service nova] Creating event network-changed:12c59a69-5657-4426-9266-ea6ab28bbd96 for instance a50f4b20-cc8e-40bf-925f-823811815d70 on hv-cinder-85407 Aug 23 08:25:24.291198 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-f29d4575-474d-49e3-8419-756686abe70f req-4cd47e59-3d0f-44d4-8edc-99d5a41b280a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038468 Aug 23 08:25:24.291986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 386/801] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:24.507556 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:24.508282 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:24.518536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:24.522770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:24.531099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:24.531099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:24.531099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:24.531099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:25.050173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:25.059063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1fb3f504-6551-4d27-bd04-5d3ce52dfaff tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1272 microversion: 2.1 time: 0.555748 Aug 23 08:25:25.059960 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 416/802] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:24 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1272 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:26.082375 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:26.083760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:26.091376 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:26.092139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:26.092744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:26.093760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:26.094382 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:26.095570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:26.286569 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:26.298640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f300e23b-5a82-4814-9e1b-483cbe06aba0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.220041 Aug 23 08:25:26.300926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 387/803] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:26 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:27.319956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:27.320502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:27.327096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:27.327576 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:27.328009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:27.328691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:27.329146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:27.329568 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:27.470403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:27.478270 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-da6c25a8-e0f1-4e96-bf93-938245a5446f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.162068 Aug 23 08:25:27.478843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 417/804] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:27 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:28.499591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:28.500202 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:28.502784 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:28.503494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=6 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:28.508700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:28.509185 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:28.509621 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:28.510309 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:28.510767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:28.511233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:28.645002 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:28.652720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9bb0dc0d-267c-4f33-af6b-be0c38e2a6dc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.157397 Aug 23 08:25:28.653284 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 388/805] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:28 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:29.674515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:29.675164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:29.677581 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=4 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:29.682760 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:29.683348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:29.683783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:29.684480 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:29.684964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:29.685764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:29.823071 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:29.832687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4a1a6d37-6e30-481c-a923-b11bd137ff14 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.162097 Aug 23 08:25:29.832896 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 418/806] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:29 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:30.854283 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:30.855549 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:30.863089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:30.863586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:30.864026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:30.864730 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:30.865188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:30.865811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:31.013503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:31.023049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0d18255e-0b38-4cb4-8cd6-10c130b0852e tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.173114 Aug 23 08:25:31.024344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 389/807] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:30 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:32.049656 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:32.057990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:32.063200 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:32.064645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:32.065305 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:32.066259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:32.066930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:32.068168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:32.233328 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:32.241511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-421655cb-504a-49ee-aa23-55adef295d31 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.200009 Aug 23 08:25:32.242899 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 419/808] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:32 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:32.655164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:25:32.655584 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Tue Aug 23 08:25:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:25:33.262160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:33.262774 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:33.269315 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:33.269817 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:33.270258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:33.270966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:33.271500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:33.271973 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:33.407940 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:33.417068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-811df292-541b-486a-894d-08e760231e42 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.158731 Aug 23 08:25:33.418274 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 390/809] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:33 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:34.441654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:34.446098 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:34.453585 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:34.454089 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:34.454525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:34.455871 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:34.456330 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:34.456754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:34.597888 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b5dd4a1b-4b21-46da-9622-df4b914cc88a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'create', calling method: .version_select at 0x7fa619e1a160>, body: {"keypair": {"name": "tempest-keypair-1780044312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvAfiwbBg9TDfw0Spe0DciMhmbTlbFgQbZYKVoUUISEyOxZ5WfvJl1TPPyJZPaJHn29IZMEcHCc9kiPrG/DsrppcixjHPiIfp6cENcXy6x+Gpks2nxh0rn2L6VM8SWRyw=="}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:34.613860 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-b5dd4a1b-4b21-46da-9622-df4b914cc88a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Getting quotas for project 6c920ebfb7b046e08503e02473294eab. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:25:34.618305 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-b5dd4a1b-4b21-46da-9622-df4b914cc88a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Getting quotas for user 6960cb25d98c4b02a80900d97ab34a5a and project 6c920ebfb7b046e08503e02473294eab. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:25:34.621744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:34.636927 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6497bad3-a768-4dd6-8584-3f6be9133646 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.198551 Aug 23 08:25:34.642807 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 420/810] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:34 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:34.729744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b5dd4a1b-4b21-46da-9622-df4b914cc88a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.262770 Aug 23 08:25:34.737541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 391/811] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:25:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:25:35.657731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:35.658358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:35.664709 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:35.665210 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:35.665645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:35.666327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:35.666775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:35.667223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:35.806254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:35.814044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1b4958fe-5aac-4594-ad25-cf87b77da743 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.160229 Aug 23 08:25:35.815258 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 421/812] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:35 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:36.800144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-df92a786-820b-4f48-8c7a-32a257fe2e36 req-4ef0d026-17ad-4d7f-9a62-11ccc7a2111e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50f4b20-cc8e-40bf-925f-823811815d70", "name": "network-vif-plugged", "status": "completed", "tag": "12c59a69-5657-4426-9266-ea6ab28bbd96"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:36.811854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-df92a786-820b-4f48-8c7a-32a257fe2e36 req-4ef0d026-17ad-4d7f-9a62-11ccc7a2111e service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:36.812442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-df92a786-820b-4f48-8c7a-32a257fe2e36 req-4ef0d026-17ad-4d7f-9a62-11ccc7a2111e service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:36.812946 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-df92a786-820b-4f48-8c7a-32a257fe2e36 req-4ef0d026-17ad-4d7f-9a62-11ccc7a2111e service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:36.824139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-df92a786-820b-4f48-8c7a-32a257fe2e36 req-4ef0d026-17ad-4d7f-9a62-11ccc7a2111e service nova] Creating event network-vif-plugged:12c59a69-5657-4426-9266-ea6ab28bbd96 for instance a50f4b20-cc8e-40bf-925f-823811815d70 on hv-cinder-85407 Aug 23 08:25:36.829142 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-df92a786-820b-4f48-8c7a-32a257fe2e36 req-4ef0d026-17ad-4d7f-9a62-11ccc7a2111e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033196 Aug 23 08:25:36.829777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 392/813] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:36.839392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:36.839996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:36.846506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:36.847203 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:36.847639 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:36.848333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:36.848785 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:36.849214 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:37.010096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:37.022409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5c988e6c-134e-48e4-9f37-118fc312a250 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.186682 Aug 23 08:25:37.027101 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 422/814] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:36 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:37.265210 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1817016525", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8958c87f-457e-4a28-a97e-406303587bed"}], "security_groups": [{"name": "tempest-securitygroup--1771309691"}], "key_name": "tempest-keypair-1780044312", "user_data": "}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:37.375772 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] validate_networks() for [('8958c87f-457e-4a28-a97e-406303587bed', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:25:37.754827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:25:37.755349 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:25:37.755827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:25:37.756268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:25:37.756684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:25:37.767241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:37.767732 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:37.768178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:37.770871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:37.770871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:37.770871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:37.791204 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Getting quotas for project 6c920ebfb7b046e08503e02473294eab. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:25:37.795947 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Getting quotas for user 6960cb25d98c4b02a80900d97ab34a5a and project 6c920ebfb7b046e08503e02473294eab. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:25:37.809486 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:25:37.811976 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:25:37.954575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d8398e9e-8787-4d20-97e0-c7a7b2370bcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.694302 Aug 23 08:25:37.955313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 393/815] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:25:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:25:37.966271 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a402b096-1a37-401d-94f7-12816d56846c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:37.966883 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a402b096-1a37-401d-94f7-12816d56846c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:38.028128 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a402b096-1a37-401d-94f7-12816d56846c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:38.036454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a402b096-1a37-401d-94f7-12816d56846c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1238 microversion: 2.1 time: 0.073912 Aug 23 08:25:38.039757 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 423/816] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:37 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1238 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:38.056280 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:38.057081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:38.065107 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:38.065966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:38.066412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:38.067206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:38.069388 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:38.070165 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:38.240945 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:38.253923 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-79b8afd6-9b51-4feb-8286-aaad68af1820 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.202189 Aug 23 08:25:38.254737 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 394/817] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:38 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:39.057879 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7f3a76f2-0234-4c73-baf3-a8e71946e261 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:39.058485 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7f3a76f2-0234-4c73-baf3-a8e71946e261 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:39.116106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7f3a76f2-0234-4c73-baf3-a8e71946e261 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:39.122956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7f3a76f2-0234-4c73-baf3-a8e71946e261 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1238 microversion: 2.1 time: 0.069065 Aug 23 08:25:39.123495 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 424/818] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:39 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:39.274538 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:39.275188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:39.278752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:39.282279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:39.282771 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:39.283823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:39.284520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:39.284987 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:39.285473 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:39.418751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:39.433141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a5a82954-01c0-4e99-b4e4-cb377f63afd6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1260 microversion: 2.1 time: 0.162610 Aug 23 08:25:39.433709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 395/819] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:39 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:40.143668 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:40.144307 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:40.150699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:40.152187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:40.152187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:40.152583 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:40.152852 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:40.153283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:40.215573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:40.219021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:40.223699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-72021371-8462-41e6-a41b-c28f8c4be020 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1290 microversion: 2.1 time: 0.084016 Aug 23 08:25:40.224270 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 425/820] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:40 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:40.453948 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:40.454564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:40.461720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:40.462300 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:40.462748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:40.463470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:40.463933 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:40.464360 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:40.482713 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:40.598790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:40.606748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7e16583e-2dce-4732-8f9e-24ae277f5543 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1443 microversion: 2.1 time: 0.156743 Aug 23 08:25:40.607345 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 396/821] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:40 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:40.628039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:40.628910 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:40.635455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:40.635940 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:40.636370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:40.637113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:40.637509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:40.637937 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:40.773377 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:40.781117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e055c38b-83fc-47d8-9978-4d6541d16985 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1443 microversion: 2.1 time: 0.156933 Aug 23 08:25:40.781682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 426/822] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:40 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:41.247312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:41.248213 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:41.255765 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:41.256248 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:41.256908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:41.257606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:41.258069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:41.258492 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:41.335465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:41.343091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d4ded493-2b71-4c0f-a42e-e5ace98043ca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1296 microversion: 2.1 time: 0.100001 Aug 23 08:25:41.343657 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 397/823] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:41 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:42.328540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-542b7065-7d24-4783-9903-130a7d565cf6 req-f8bcaa1f-5cb9-4417-a364-f15b63dc72f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf370581-da67-41d0-9698-a68121dd8715", "tag": "fbecc190-4008-4061-994b-b366d41f0d8d"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:42.340301 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-542b7065-7d24-4783-9903-130a7d565cf6 req-f8bcaa1f-5cb9-4417-a364-f15b63dc72f8 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:42.343682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-542b7065-7d24-4783-9903-130a7d565cf6 req-f8bcaa1f-5cb9-4417-a364-f15b63dc72f8 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:42.343682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-542b7065-7d24-4783-9903-130a7d565cf6 req-f8bcaa1f-5cb9-4417-a364-f15b63dc72f8 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:42.354741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-542b7065-7d24-4783-9903-130a7d565cf6 req-f8bcaa1f-5cb9-4417-a364-f15b63dc72f8 service nova] Creating event network-changed:fbecc190-4008-4061-994b-b366d41f0d8d for instance cf370581-da67-41d0-9698-a68121dd8715 on hv-cinder-85407 Aug 23 08:25:42.360494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-542b7065-7d24-4783-9903-130a7d565cf6 req-f8bcaa1f-5cb9-4417-a364-f15b63dc72f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036524 Aug 23 08:25:42.361611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 427/824] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:42.365581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:42.367381 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:42.378181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:42.378181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:42.378181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:42.378181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:42.378574 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:42.378972 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:42.621997 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:42.630480 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-810dbd3c-5061-4c54-9cee-8dc3464a1cf1 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1364 microversion: 2.1 time: 0.269888 Aug 23 08:25:42.631094 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 398/825] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:42 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:25:42.971971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-3e8080fd-53f6-4b11-8c55-9fa01debe26e req-ab9faf49-5b30-46c1-942c-b47ac89eb0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50f4b20-cc8e-40bf-925f-823811815d70", "tag": "12c59a69-5657-4426-9266-ea6ab28bbd96"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:42.982158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3e8080fd-53f6-4b11-8c55-9fa01debe26e req-ab9faf49-5b30-46c1-942c-b47ac89eb0b6 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:42.983091 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3e8080fd-53f6-4b11-8c55-9fa01debe26e req-ab9faf49-5b30-46c1-942c-b47ac89eb0b6 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:42.983593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3e8080fd-53f6-4b11-8c55-9fa01debe26e req-ab9faf49-5b30-46c1-942c-b47ac89eb0b6 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:42.997907 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-3e8080fd-53f6-4b11-8c55-9fa01debe26e req-ab9faf49-5b30-46c1-942c-b47ac89eb0b6 service nova] Creating event network-changed:12c59a69-5657-4426-9266-ea6ab28bbd96 for instance a50f4b20-cc8e-40bf-925f-823811815d70 on hv-cinder-85407 Aug 23 08:25:43.003596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-3e8080fd-53f6-4b11-8c55-9fa01debe26e req-ab9faf49-5b30-46c1-942c-b47ac89eb0b6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035540 Aug 23 08:25:43.004555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 428/826] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:43.651392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:43.652034 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:43.658985 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:43.659479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:43.659919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:43.660615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:43.661075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:43.661500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:43.793140 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:43.801178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1bd3a9ba-ee02-48dd-b6f7-6e3a471db61b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1364 microversion: 2.1 time: 0.153794 Aug 23 08:25:43.801957 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 399/827] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:43 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:44.822878 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:44.823594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:44.829742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:44.830844 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:44.831304 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:44.831978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:44.832423 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:44.832840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:44.963535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:44.971667 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-aa3d2f06-560c-46ad-9886-fc114fbf4f46 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1364 microversion: 2.1 time: 0.153669 Aug 23 08:25:44.972245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 429/828] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:44 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:45.991866 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:45.992475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:45.999077 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:45.999562 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:46.000028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:46.000680 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:46.001127 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:46.001564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:46.129244 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:46.136720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d9c2d4c7-afd3-483a-8493-9d1c6088ade4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1364 microversion: 2.1 time: 0.148821 Aug 23 08:25:46.137277 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 400/829] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:45 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:47.157754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:47.158817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:47.161265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:47.165942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:47.166420 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:47.166855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:47.167565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:47.168025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:47.172559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:47.300973 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:47.308532 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-61c8f046-f5d3-49e6-a532-fabac871859a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1364 microversion: 2.1 time: 0.154868 Aug 23 08:25:47.309096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 430/830] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:47 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:48.329573 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:48.330127 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:48.332645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:48.333428 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=10 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:48.338121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:48.343921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:48.343921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:48.343921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:48.343921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:48.344298 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:48.466424 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:48.473960 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-200b226e-1d8b-4309-9291-b7d6af462257 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1364 microversion: 2.1 time: 0.148360 Aug 23 08:25:48.474531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 401/831] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:48 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:48.824599 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-032c1361-7895-4b30-aa23-d7af1e5e3186 req-fc26bd79-acf6-4c94-9da4-8f50f2411122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf370581-da67-41d0-9698-a68121dd8715", "name": "network-vif-plugged", "status": "completed", "tag": "fbecc190-4008-4061-994b-b366d41f0d8d"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:48.834537 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-032c1361-7895-4b30-aa23-d7af1e5e3186 req-fc26bd79-acf6-4c94-9da4-8f50f2411122 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:48.835047 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-032c1361-7895-4b30-aa23-d7af1e5e3186 req-fc26bd79-acf6-4c94-9da4-8f50f2411122 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:48.835474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-032c1361-7895-4b30-aa23-d7af1e5e3186 req-fc26bd79-acf6-4c94-9da4-8f50f2411122 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:48.848129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-032c1361-7895-4b30-aa23-d7af1e5e3186 req-fc26bd79-acf6-4c94-9da4-8f50f2411122 service nova] Creating event network-vif-plugged:fbecc190-4008-4061-994b-b366d41f0d8d for instance cf370581-da67-41d0-9698-a68121dd8715 on hv-cinder-85407 Aug 23 08:25:48.852927 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-032c1361-7895-4b30-aa23-d7af1e5e3186 req-fc26bd79-acf6-4c94-9da4-8f50f2411122 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032329 Aug 23 08:25:48.853405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 431/832] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:49.494332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:49.494862 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:49.501245 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:49.501725 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:49.502175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:49.502845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:49.503866 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:49.504269 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:49.630028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:49.637555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-581022e2-e333-48f5-bfd5-60c953084ec2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1364 microversion: 2.1 time: 0.147307 Aug 23 08:25:49.638112 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 402/833] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:49 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:50.654822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=4 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:25:50.659513 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:50.660242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:50.666331 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:50.668846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:50.668846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:50.668846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:50.668846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:50.669214 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:50.802197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:50.809722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b6f19687-eff2-401b-8858-9423d3f08884 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1364 microversion: 2.1 time: 0.155882 Aug 23 08:25:50.810285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 432/834] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:50 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:51.829696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:51.830311 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:51.837667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:51.838159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:51.838628 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:51.839354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:51.839835 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:51.840265 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:51.966326 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:25:51.973950 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-de1df0d2-4ca5-497a-8c90-f8d08d073ac9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1548 microversion: 2.1 time: 0.148109 Aug 23 08:25:51.974520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 403/835] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:25:51 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:25:51.994210 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:25:51.994699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:25:52.001040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:52.001522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:52.001962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:52.002645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:52.003129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:52.004117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:52.079992 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bd808470-b9bf-4de0-a8fe-7808920052ea tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089547 Aug 23 08:25:52.080574 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 433/836] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Aug 23 08:25:51 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:25:53.041031 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-0171c335-1b5f-45d2-bfbe-40e25f04698c req-1f39d558-7076-424f-8910-124ff0b43546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf370581-da67-41d0-9698-a68121dd8715", "tag": "fbecc190-4008-4061-994b-b366d41f0d8d"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:25:53.051613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0171c335-1b5f-45d2-bfbe-40e25f04698c req-1f39d558-7076-424f-8910-124ff0b43546 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:25:53.052181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0171c335-1b5f-45d2-bfbe-40e25f04698c req-1f39d558-7076-424f-8910-124ff0b43546 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:25:53.052698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0171c335-1b5f-45d2-bfbe-40e25f04698c req-1f39d558-7076-424f-8910-124ff0b43546 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:25:53.063580 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-0171c335-1b5f-45d2-bfbe-40e25f04698c req-1f39d558-7076-424f-8910-124ff0b43546 service nova] Creating event network-changed:fbecc190-4008-4061-994b-b366d41f0d8d for instance cf370581-da67-41d0-9698-a68121dd8715 on hv-cinder-85407 Aug 23 08:25:53.069203 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-0171c335-1b5f-45d2-bfbe-40e25f04698c req-1f39d558-7076-424f-8910-124ff0b43546 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031902 Aug 23 08:25:53.070047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 404/837] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:26:18.249407 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=7 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:18.250158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=34 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:18.254146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1233437150"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:26:18.254702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:18.260639 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:18.261735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:18.262530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:18.262838 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:18.263316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:18.263738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:18.387899 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.network.security_group_api [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Removing security group 98f6c1c2-e258-480a-ac97-73d0ccc158fa from port aa589549-304f-49d3-929c-bf7ebc1aae56 Aug 23 08:26:18.823856 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-feca9cf7-6004-41e3-893b-03f47ad7e8f9 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "POST /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/action" status: 202 len: 0 microversion: 2.1 time: 0.575765 Aug 23 08:26:18.824731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 434/838] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:26:18 2022] POST /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:26:18.832964 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-af75eefe-056b-406e-a679-f9032d63cfb4 req-288ef123-74c4-4a78-899a-c8d28f03c88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab53478c-2139-4154-9a51-3760c278c8c3", "tag": "aa589549-304f-49d3-929c-bf7ebc1aae56"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:26:18.838234 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=18 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:18.838888 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=46 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:18.845177 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-af75eefe-056b-406e-a679-f9032d63cfb4 req-288ef123-74c4-4a78-899a-c8d28f03c88b service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:18.845661 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-af75eefe-056b-406e-a679-f9032d63cfb4 req-288ef123-74c4-4a78-899a-c8d28f03c88b service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:18.846138 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-af75eefe-056b-406e-a679-f9032d63cfb4 req-288ef123-74c4-4a78-899a-c8d28f03c88b service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:18.886601 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-af75eefe-056b-406e-a679-f9032d63cfb4 req-288ef123-74c4-4a78-899a-c8d28f03c88b service nova] Creating event network-changed:aa589549-304f-49d3-929c-bf7ebc1aae56 for instance ab53478c-2139-4154-9a51-3760c278c8c3 on hv-cinder-85407 Aug 23 08:26:18.895942 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-af75eefe-056b-406e-a679-f9032d63cfb4 req-288ef123-74c4-4a78-899a-c8d28f03c88b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066988 Aug 23 08:26:18.896483 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 405/839] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:26:20.497128 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:20.497657 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:20.503686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:20.504172 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:20.504609 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:20.505303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:20.505767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:20.506193 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:20.596949 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lazy-loading 'services' on Instance uuid ab53478c-2139-4154-9a51-3760c278c8c3 {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:26:20.877730 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-625122ce-52a8-4186-8233-96142974cde8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments/144a904c-bc28-4729-9fdc-303e12f2cc3f" status: 202 len: 0 microversion: 2.1 time: 0.384806 Aug 23 08:26:20.878308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 435/840] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:26:20 2022] DELETE /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments/144a904c-bc28-4729-9fdc-303e12f2cc3f => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:26:20.888553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:20.891062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:20.898725 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:20.899320 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:20.899875 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:20.900724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:20.901245 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:20.901734 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:20.911406 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-cf12720d-ff44-4057-a6e1-df7a43d907cb req-a7368c90-965b-42e2-a18b-0db87f06dec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab53478c-2139-4154-9a51-3760c278c8c3", "tag": "aa589549-304f-49d3-929c-bf7ebc1aae56"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:26:20.921641 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-cf12720d-ff44-4057-a6e1-df7a43d907cb req-a7368c90-965b-42e2-a18b-0db87f06dec9 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:20.922186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-cf12720d-ff44-4057-a6e1-df7a43d907cb req-a7368c90-965b-42e2-a18b-0db87f06dec9 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:20.922683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-cf12720d-ff44-4057-a6e1-df7a43d907cb req-a7368c90-965b-42e2-a18b-0db87f06dec9 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:20.934156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-cf12720d-ff44-4057-a6e1-df7a43d907cb req-a7368c90-965b-42e2-a18b-0db87f06dec9 service nova] Creating event network-changed:aa589549-304f-49d3-929c-bf7ebc1aae56 for instance ab53478c-2139-4154-9a51-3760c278c8c3 on hv-cinder-85407 Aug 23 08:26:20.934686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-91bc2ae6-62eb-4032-b36c-85ffd84782e2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051623 Aug 23 08:26:20.939353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 406/841] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:26:20 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:26:20.939509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-cf12720d-ff44-4057-a6e1-df7a43d907cb req-a7368c90-965b-42e2-a18b-0db87f06dec9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032149 Aug 23 08:26:20.940071 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 436/842] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:26:21.947170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:21.949331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:21.955819 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:21.956296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:21.956722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:21.957399 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:21.957849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:21.958268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:21.988325 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d90ff0ac-7725-4514-929b-11ea363bd8ad tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Aug 23 08:26:21.988947 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 407/843] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:26:21 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:26:23.001712 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:23.004018 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:23.010009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:23.010479 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:23.010903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:23.011600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:23.012043 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:23.012974 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:23.040726 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a116028c-7438-4f82-9d4b-b5ee057b70b2 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043970 Aug 23 08:26:23.041189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 437/844] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:26:22 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:26:23.051651 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:23.052142 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:23.058500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:23.059021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:23.059465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:23.060160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:23.060621 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:23.061050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:23.134013 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] HTTP exception thrown: Instance ab53478c-2139-4154-9a51-3760c278c8c3 is not attached to volume 144a904c-bc28-4729-9fdc-303e12f2cc3f Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Request method failure captured: Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments/144a904c-bc28-4729-9fdc-303e12f2cc3f HTTP/1.1 Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI4X5uOMssKIKsivY7AZq_lOoHOerbekeaJGi8pBq6Q7ZSbEuLxQvj4BIcGnjI5IwZAvM-eXO1sQysZTEKud89M8M1NwixJOdM6PEEWpeKittVF_muEF8MIVmmCkC6QJKtxsESowMXaJWf1RCPNouuw7ymmy1HGl2uyvpALFa5wWaJg Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: d6382332279746739a247cfb7085cebf Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-TestMinimumBasicScenario-1349143580 Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:26:23.136451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d6382332279746739a247cfb7085cebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d6382332279746739a247cfb7085cebf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d6382332279746739a247cfb7085cebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d6382332279746739a247cfb7085cebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-TestMinimumBasicScenario-1349143580 Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: d6382332279746739a247cfb7085cebf Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1349143580 Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-TestMinimumBasicScenario-1349143580-project Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: 6a05807b7fd04df38e3d1fa455ec2384 Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-TestMinimumBasicScenario-1349143580-project Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:26:23.138696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance ab53478c-2139-4154-9a51-3760c278c8c3 is not attached to volume 144a904c-bc28-4729-9fdc-303e12f2cc3f Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'server_id': 'ab53478c-2139-4154-9a51-3760c278c8c3', 'id': '144a904c-bc28-4729-9fdc-303e12f2cc3f'} Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 144a904c-bc28-4729-9fdc-303e12f2cc3f. Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:26:23.139745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab53478c-2139-4154-9a51-3760c278c8c3 is not attached to volume 144a904c-bc28-4729-9fdc-303e12f2cc3f Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab53478c-2139-4154-9a51-3760c278c8c3 is not attached to volume 144a904c-bc28-4729-9fdc-303e12f2cc3f Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:26:23.141233 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Returning 404 to user: Instance ab53478c-2139-4154-9a51-3760c278c8c3 is not attached to volume 144a904c-bc28-4729-9fdc-303e12f2cc3f {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:26:23.142353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-65df81d3-57c0-41a0-90fc-ecaa4fe7c51e tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments/144a904c-bc28-4729-9fdc-303e12f2cc3f" status: 404 len: 154 microversion: 2.1 time: 0.090795 Aug 23 08:26:23.142353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 408/845] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:26:23 2022] DELETE /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3/os-volume_attachments/144a904c-bc28-4729-9fdc-303e12f2cc3f => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:26:24.380826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:24.381328 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:24.387660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:24.388145 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:24.388586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:24.389273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:24.389733 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:24.390159 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:24.413983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:26:24.786770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b755d270-6e40-4d05-ab0f-ebf21c5cadd7 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 204 len: 0 microversion: 2.1 time: 0.409446 Aug 23 08:26:24.787502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 438/846] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:26:24 2022] DELETE /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:26:24.796385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:24.797003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:24.803493 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:24.803977 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:24.804415 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:24.805113 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:24.805570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:24.805999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:24.938750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:24.946641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bcf14f19-f4a9-4c49-9c03-9fd3afaf4ee5 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1553 microversion: 2.1 time: 0.154891 Aug 23 08:26:24.947239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 409/847] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:26:24 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:26:25.968283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:25.969013 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:25.975442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:25.975925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:25.976365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:25.977052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:25.977507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:25.977928 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:26.111951 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:26.115585 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7025e8f4-33d6-4130-9e9f-15ad9f015155 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1553 microversion: 2.1 time: 0.151529 Aug 23 08:26:26.116151 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 439/848] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:26:25 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:26:27.136697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:27.137885 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:27.143935 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:27.144425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:27.144883 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:27.145559 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:27.146042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:27.146471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:27.357278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:27.365147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d5ec5c1c-50a2-40d6-b84f-e7124922f650 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1553 microversion: 2.1 time: 0.232385 Aug 23 08:26:27.365723 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 410/849] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:26:27 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:26:27.641185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-7c97d54b-419c-4d05-94cc-8f66dadaf473 req-ece3f683-5867-49c0-bd0f-4489eee18f84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab53478c-2139-4154-9a51-3760c278c8c3", "name": "network-vif-deleted", "tag": "aa589549-304f-49d3-929c-bf7ebc1aae56"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:26:27.650787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-7c97d54b-419c-4d05-94cc-8f66dadaf473 req-ece3f683-5867-49c0-bd0f-4489eee18f84 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:27.654011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-7c97d54b-419c-4d05-94cc-8f66dadaf473 req-ece3f683-5867-49c0-bd0f-4489eee18f84 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:27.654011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-7c97d54b-419c-4d05-94cc-8f66dadaf473 req-ece3f683-5867-49c0-bd0f-4489eee18f84 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:27.663297 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-7c97d54b-419c-4d05-94cc-8f66dadaf473 req-ece3f683-5867-49c0-bd0f-4489eee18f84 service nova] Creating event network-vif-deleted:aa589549-304f-49d3-929c-bf7ebc1aae56 for instance ab53478c-2139-4154-9a51-3760c278c8c3 on hv-cinder-85407 Aug 23 08:26:27.668035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-7c97d54b-419c-4d05-94cc-8f66dadaf473 req-ece3f683-5867-49c0-bd0f-4489eee18f84 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031056 Aug 23 08:26:27.668599 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 440/850] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:26:28.386294 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:28.386904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:28.393300 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:28.394123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:28.394260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:28.394971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:28.395441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:28.395872 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:28.425860 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:28.426345 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:28.426782 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:28.427263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lazy-loading 'fault' on Instance uuid ab53478c-2139-4154-9a51-3760c278c8c3 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:26:28.468604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a05807b7fd04df38e3d1fa455ec2384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6382332279746739a247cfb7085cebf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:28.476243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-106e1bc6-5b92-43ac-b42a-4eba132706e8 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 200 len: 1348 microversion: 2.1 time: 0.093890 Aug 23 08:26:28.476807 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 411/851] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:26:28 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:26:29.499335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:29.500035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] [instance: ab53478c-2139-4154-9a51-3760c278c8c3] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:29.506148 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:29.506634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:29.507104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:29.507798 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:29.508254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:29.508680 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:29.522523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] HTTP exception thrown: Instance ab53478c-2139-4154-9a51-3760c278c8c3 could not be found. Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Request method failure captured: Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 HTTP/1.1 Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI4X5uOMssKIKsivY7AZq_lOoHOerbekeaJGi8pBq6Q7ZSbEuLxQvj4BIcGnjI5IwZAvM-eXO1sQysZTEKud89M8M1NwixJOdM6PEEWpeKittVF_muEF8MIVmmCkC6QJKtxsESowMXaJWf1RCPNouuw7ymmy1HGl2uyvpALFa5wWaJg Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: d6382332279746739a247cfb7085cebf Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-TestMinimumBasicScenario-1349143580 Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:26:29.524173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d6382332279746739a247cfb7085cebf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d6382332279746739a247cfb7085cebf", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d6382332279746739a247cfb7085cebf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d6382332279746739a247cfb7085cebf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-TestMinimumBasicScenario-1349143580 Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: d6382332279746739a247cfb7085cebf Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1349143580 Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-TestMinimumBasicScenario-1349143580-project Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 6a05807b7fd04df38e3d1fa455ec2384 Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-TestMinimumBasicScenario-1349143580-project Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance ab53478c-2139-4154-9a51-3760c278c8c3 could not be found. Aug 23 08:26:29.525744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'ab53478c-2139-4154-9a51-3760c278c8c3'} Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab53478c-2139-4154-9a51-3760c278c8c3 could not be found. Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:26:29.526717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab53478c-2139-4154-9a51-3760c278c8c3 could not be found. Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab53478c-2139-4154-9a51-3760c278c8c3 could not be found. Aug 23 08:26:29.528276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:26:29.529600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Returning 404 to user: Instance ab53478c-2139-4154-9a51-3760c278c8c3 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:26:29.529600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ee6abc50-4249-4aa3-98bc-b9e6274e2a40 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3" status: 404 len: 111 microversion: 2.1 time: 0.031628 Aug 23 08:26:29.529600 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 441/852] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:26:29 2022] GET /compute/v2.1/servers/ab53478c-2139-4154-9a51-3760c278c8c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:26:29.534571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c4c715d0-4467-45c5-bc78-5e8db5ccbce0 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] Calling method '.version_select at 0x7fa619e3f9d0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:29.605366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c4c715d0-4467-45c5-bc78-5e8db5ccbce0 tempest-TestMinimumBasicScenario-1349143580 tempest-TestMinimumBasicScenario-1349143580-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1418307142" status: 202 len: 0 microversion: 2.1 time: 0.074577 Aug 23 08:26:29.605947 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 412/853] 10.222.0.58 () {58 vars in 1272 bytes} [Tue Aug 23 08:26:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1418307142 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:26:42.313470 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:42.314027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:42.316337 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:42.317018 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:42.321697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:42.322147 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:42.322577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:42.323292 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:42.323743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:42.324166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:42.347890 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fc7c43b0-5aca-483a-aaab-7e570fe0a3e7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/ips" status: 200 len: 151 microversion: 2.20 time: 0.038861 Aug 23 08:26:42.348446 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 442/854] 10.222.0.58 () {60 vars in 1289 bytes} [Tue Aug 23 08:26:42 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:26:45.495894 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=40 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:45.496337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:26:45.500994 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:26:45.501534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:45.508424 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:45.508918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:45.509411 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:45.517160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:45.517160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:45.517160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:45.533298 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lazy-loading 'flavor' on Instance uuid b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:26:46.050065 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c74f8bd4-3155-46fe-b4e9-6d9821e4ccf7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/action" status: 202 len: 0 microversion: 2.20 time: 0.555893 Aug 23 08:26:46.050647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 413/855] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Aug 23 08:26:45 2022] POST /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/action => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:26:46.059610 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:46.060228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:46.067461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:46.067946 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:46.068384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:46.069081 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:46.069539 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:46.069966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:46.198099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:46.207009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:46.208623 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:46.209771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-aaad7825-d36c-45a2-ab9f-db73732f7ab2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.154790 Aug 23 08:26:46.210324 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 443/856] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:46 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:47.233199 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:47.233898 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:47.240241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:47.240727 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:47.241167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:47.241897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:47.242362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:47.242789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:47.373691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:47.381837 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:47.383392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:47.384600 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0555e14f-f025-4f08-81b0-db3abc7fb9eb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.156262 Aug 23 08:26:47.385162 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 414/857] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:47 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:48.407744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:48.408303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:48.415248 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:48.415731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:48.416166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:48.416852 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:48.417309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:48.417736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:48.543895 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:48.552511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:48.553995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:48.555154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e6c14555-3055-45be-8130-48263093e7fc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.151362 Aug 23 08:26:48.555706 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 444/858] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:48 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:49.578500 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:49.579172 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:49.585620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:49.586094 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:49.586524 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:49.587235 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:49.587689 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:49.588108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:49.718244 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:49.726344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:49.727871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:49.729018 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0fc492ff-398e-4029-894a-72d51e3947db tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.154684 Aug 23 08:26:49.729825 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 415/859] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:49 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:50.752474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:50.753084 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:50.759809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:50.760293 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:50.760730 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:50.761421 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:50.761951 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:50.762378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:50.890769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:50.898810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:50.900378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:50.901511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d2b77db5-4c12-4083-89da-ab8e4941decc tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.153025 Aug 23 08:26:50.902060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 445/860] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:50 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:51.923744 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:51.924353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:51.930775 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:51.931286 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:51.931721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:51.932410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:51.932860 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:51.933285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:52.058797 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:52.067702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:52.069221 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:52.070383 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-944d5788-de59-4fa7-b97c-1ac86cd6a4f2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.150628 Aug 23 08:26:52.070966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 416/861] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:51 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:53.094496 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:53.095062 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:53.101507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:53.101990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:53.102421 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:53.103161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:53.103619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:53.104045 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:53.234988 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:53.243176 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:53.244677 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:53.245857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e2642d3a-5313-441f-b653-100a298e5cf9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.155987 Aug 23 08:26:53.246445 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 446/862] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:53 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:54.268686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:54.269293 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:54.275665 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:54.276141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:54.276568 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:54.277246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:54.277698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:54.278118 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:54.403488 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:54.411453 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:54.412942 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:54.414073 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f4556cd3-4ec6-4d9b-b067-a1d8b60c6a9f tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.149993 Aug 23 08:26:54.414633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 417/863] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:54 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:26:55.437131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:55.437715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:55.444073 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:55.444550 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:55.444981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:55.445658 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:55.446109 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:55.446528 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:55.576802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:55.585145 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:55.586677 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:55.587857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-793fc63c-9b2c-4d9b-aa4a-d98f4466d029 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.155143 Aug 23 08:26:55.588406 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 447/864] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:55 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:56.611739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:56.612346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:56.618670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:56.619193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:56.619629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:56.620350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:56.620800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:56.621216 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:56.747332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:56.756132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:56.757639 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:56.758795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d52c6f88-5f8b-4c5d-8b10-558f1b2abaa0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.151592 Aug 23 08:26:56.759377 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 418/865] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:56 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:57.782283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:57.782692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:57.788998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:57.789502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:57.789939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:57.790634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:57.791123 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:57.791548 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:58.121650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:58.130442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:58.131980 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:58.133137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d60220a5-5744-4850-b454-6e808807af90 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1742 microversion: 2.20 time: 0.355459 Aug 23 08:26:58.133694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 448/866] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:57 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1742 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:26:59.156626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:26:59.157309 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:26:59.164436 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:59.164922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:59.165488 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:59.166191 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:26:59.166644 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:26:59.167085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:26:59.351955 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:59.360186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:59.361697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:26:59.362881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-46793338-04b1-4e0f-bee1-f1f69fa094ae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1742 microversion: 2.20 time: 0.210685 Aug 23 08:26:59.363497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 419/867] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:26:59 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1742 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:00.386429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:00.387034 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:00.393931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:00.394416 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:00.394852 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:00.395562 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:00.396027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:00.396453 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:00.521240 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:00.529296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:00.539762 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:00.539762 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-33d7549a-d836-4b8e-af7c-62f5a14069d5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1742 microversion: 2.20 time: 0.150363 Aug 23 08:27:00.539762 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 449/868] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:00 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:01.010455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-f6e6ef89-d1e0-4610-beaa-675a2b55ccd8 req-d32ec504-c6ba-40aa-83ac-5b817875a9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c", "name": "network-vif-plugged", "status": "completed", "tag": "8e36973f-5869-4694-b64a-1171d88a8a97"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:27:01.020961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f6e6ef89-d1e0-4610-beaa-675a2b55ccd8 req-d32ec504-c6ba-40aa-83ac-5b817875a9df service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:01.021442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f6e6ef89-d1e0-4610-beaa-675a2b55ccd8 req-d32ec504-c6ba-40aa-83ac-5b817875a9df service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:01.021873 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f6e6ef89-d1e0-4610-beaa-675a2b55ccd8 req-d32ec504-c6ba-40aa-83ac-5b817875a9df service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:01.037596 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-f6e6ef89-d1e0-4610-beaa-675a2b55ccd8 req-d32ec504-c6ba-40aa-83ac-5b817875a9df service nova] Creating event network-vif-plugged:8e36973f-5869-4694-b64a-1171d88a8a97 for instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c on hv-cinder-85407 Aug 23 08:27:01.037596 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-f6e6ef89-d1e0-4610-beaa-675a2b55ccd8 req-d32ec504-c6ba-40aa-83ac-5b817875a9df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030631 Aug 23 08:27:01.037921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 420/869] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:27:01.560378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:01.560992 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:01.567379 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:01.567859 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:01.568293 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:01.569107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:01.569563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:01.569988 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:01.700892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:01.709167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:01.710669 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:01.711841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0ff0968c-af6c-4085-85de-107b96f46dac tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1742 microversion: 2.20 time: 0.155533 Aug 23 08:27:01.712409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 450/870] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:01 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:02.736176 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:02.736875 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:02.743033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:02.743526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:02.743965 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:02.744657 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:02.745117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:02.745544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:02.874595 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:02.882760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:02.884331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:02.885482 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-08b8bc85-b772-4ec2-94f6-312763cddf24 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1742 microversion: 2.20 time: 0.154281 Aug 23 08:27:02.886046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 421/871] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:02 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:03.908714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:03.909258 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:03.915737 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:03.916211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:03.916642 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:03.917321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:03.917772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:03.918198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:04.049228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:04.057368 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:04.058865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:04.060049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-66180133-ebc0-4e46-a89c-70bbe498632d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1742 microversion: 2.20 time: 0.155799 Aug 23 08:27:04.060598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 451/872] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:03 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:05.084416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:05.085026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:05.091522 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:05.092010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:05.096451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:05.096451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:05.096451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:05.096451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:05.227696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:05.236906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:05.238746 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:05.240035 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-38986bfd-d744-4642-baa1-4c72b048277c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.159491 Aug 23 08:27:05.242979 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 422/873] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:05 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:06.263004 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:06.263677 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:06.271542 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:06.272090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:06.272532 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:06.273237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:06.273692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:06.274144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:06.428308 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:06.437816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:06.439420 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:06.440796 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-997ae500-f100-43fc-be5b-1e2ce0b93060 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.181487 Aug 23 08:27:06.455464 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 452/874] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:06 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:07.464520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:07.465242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:07.472462 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:07.472959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:07.473402 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:07.474110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:07.474570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:07.475098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:07.616304 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:07.625794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:07.627441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:07.628597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-22714fce-4ea2-4c6d-8f75-b53bde5d6cc7 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.168030 Aug 23 08:27:07.629160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 423/875] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:07 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:08.651864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:08.652380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:08.658964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:08.661758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:08.661758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:08.661758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:08.661758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:08.662111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:08.961456 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:08.972216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:08.973747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:08.974966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ed0d65dc-9ea5-4e69-9d4f-2e9b85d082e1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.327251 Aug 23 08:27:08.975717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 453/876] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:08 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:10.174732 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:10.175371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:10.181567 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:10.182050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:10.182483 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:10.183534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:10.183991 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:10.184414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:10.324117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:10.333925 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:10.335623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:10.336808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b80d35ae-0e14-40d1-91e8-78dcb6d7bb84 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.342545 Aug 23 08:27:10.337361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 424/877] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:09 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:11.366322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:11.366998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:11.373633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:11.374125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:11.374556 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:11.375298 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:11.375756 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:11.376215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:11.505699 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:11.514038 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:11.516111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:11.516993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f9f56fe3-c3d1-4f6b-bcdf-a70df1ebe02d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.155337 Aug 23 08:27:11.517540 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 454/878] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:11 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:12.542256 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:12.542864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:12.550045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:12.562237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:12.562237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:12.562237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:12.562237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:12.562597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:12.732389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:12.742677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:12.744209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:12.745427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f1c337e6-ea06-4c7f-a15c-51b97d1a1dbe tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.208158 Aug 23 08:27:12.746414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 425/879] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:12 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:13.769059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:13.769919 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:13.775983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:13.776463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:13.776893 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:13.777577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:13.778144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:13.778565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:13.917584 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:13.925693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:13.927247 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:13.928396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2faabb7f-6055-4e18-a759-b9e3f57b74e5 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.163573 Aug 23 08:27:13.929133 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 455/880] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:13 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:14.952760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:14.953655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:14.960125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:14.960607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:14.961044 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:14.961733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:14.962189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:14.962614 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:15.108852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:15.117032 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:15.118582 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:15.119764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4069998a-b132-4448-8285-311624d2bad9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.171822 Aug 23 08:27:15.120323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 426/881] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:14 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:16.143955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:16.144721 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:16.151039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:16.151567 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:16.152004 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:16.152742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:16.153152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:16.153577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:16.284694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:16.292882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:16.294381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:16.295562 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-56acfa1f-44d8-4224-8a8e-70ff5232c464 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1737 microversion: 2.20 time: 0.156073 Aug 23 08:27:16.296109 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 456/882] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:16 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:17.318007 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:17.318609 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:17.321015 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=29 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:17.325733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:17.326211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:17.326642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:17.327635 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:17.328386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:17.329268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:17.337410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:17.797722 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:17.806898 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:17.808535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:17.809775 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-395d17c3-c2a5-41b0-84f9-15c4aab66883 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1719 microversion: 2.20 time: 0.495724 Aug 23 08:27:17.810399 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 427/883] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:17 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1719 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:18.833205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:18.833815 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:18.836107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=31 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:18.840715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:18.841191 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:18.841621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:18.842371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:18.842758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:18.843268 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:18.845767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=89 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:18.974373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:18.982435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:18.983980 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:18.985132 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-332c4783-7b3a-4007-9bd0-6b0755a3234c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1719 microversion: 2.20 time: 0.155804 Aug 23 08:27:18.985677 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 457/884] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:18 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:20.008237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:20.008839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:20.015740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:20.016222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:20.016655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:20.017340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:20.017799 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:20.018619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:20.150479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:20.160452 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:20.162340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:20.163605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-810679f0-59bd-4caa-9eda-529b3341000e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1719 microversion: 2.20 time: 0.159210 Aug 23 08:27:20.164200 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 428/885] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:20 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:21.084059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-a80d83f9-bb5b-4772-9077-b47b92f8be4a req-5dd1a5bd-4329-414e-a3ff-35efd375b261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c", "name": "network-vif-unplugged", "status": "completed", "tag": "8e36973f-5869-4694-b64a-1171d88a8a97"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:27:21.096152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-a80d83f9-bb5b-4772-9077-b47b92f8be4a req-5dd1a5bd-4329-414e-a3ff-35efd375b261 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:21.096152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-a80d83f9-bb5b-4772-9077-b47b92f8be4a req-5dd1a5bd-4329-414e-a3ff-35efd375b261 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:21.096152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-a80d83f9-bb5b-4772-9077-b47b92f8be4a req-5dd1a5bd-4329-414e-a3ff-35efd375b261 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:21.105869 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-a80d83f9-bb5b-4772-9077-b47b92f8be4a req-5dd1a5bd-4329-414e-a3ff-35efd375b261 service nova] Creating event network-vif-unplugged:8e36973f-5869-4694-b64a-1171d88a8a97 for instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c on hv-cinder-85407 Aug 23 08:27:21.111537 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-a80d83f9-bb5b-4772-9077-b47b92f8be4a req-5dd1a5bd-4329-414e-a3ff-35efd375b261 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031032 Aug 23 08:27:21.112100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 458/886] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:27:21.217690 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:21.218914 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:21.225783 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:21.226277 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:21.226763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:21.227492 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:21.227959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:21.228389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:21.357334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:21.365498 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:21.367047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:21.368202 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-391a507b-7c84-4a10-84e6-53bb61af6140 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1662 microversion: 2.20 time: 0.154622 Aug 23 08:27:21.368761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 429/887] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:21 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:21.391286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de51e62e-8006-481a-83cc-4901db6d6d3c"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:27:21.393676 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:21.399812 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:21.400295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:21.400730 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:21.401447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:21.401906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:21.402337 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:22.497199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-40fb7b77-50f3-44ea-913e-27f1e8d0a66c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.110691 Aug 23 08:27:22.497831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 459/888] 10.222.0.58 () {62 vars in 1364 bytes} [Tue Aug 23 08:27:21 2022] POST /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/os-volume_attachments => generated 188 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 08:27:22.622220 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:22.622714 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:22.629071 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:22.629551 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:22.629985 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:22.630665 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:22.631151 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:22.631573 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:23.036952 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:23.037371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:23.043575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:23.044067 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:23.044538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:23.045229 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:23.045747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:23.046224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:23.069286 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a968740c-ee40-4325-bf08-cd42c19a563d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/ips" status: 200 len: 144 microversion: 2.1 time: 0.036286 Aug 23 08:27:23.069840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 460/889] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:27:23 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:27:23.303087 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-aa1963cb-fca5-4f92-8f4b-fb2d676fc4a1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/os-volume_attachments/de51e62e-8006-481a-83cc-4901db6d6d3c" status: 202 len: 0 microversion: 2.20 time: 0.684510 Aug 23 08:27:23.303693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 430/890] 10.222.0.58 () {60 vars in 1457 bytes} [Tue Aug 23 08:27:22 2022] DELETE /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/os-volume_attachments/de51e62e-8006-481a-83cc-4901db6d6d3c => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:27:23.364114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:27:23.364950 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:23.371140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:23.371621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:23.372055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:23.372743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:23.373198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:23.373619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:23.416107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121382) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 08:27:23.746139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-10a92caf-4f9f-42d5-b8fe-48909f540eee tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "POST /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/action" status: 202 len: 0 microversion: 2.20 time: 0.385957 Aug 23 08:27:23.750397 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 461/891] 10.222.0.58 () {62 vars in 1319 bytes} [Tue Aug 23 08:27:23 2022] POST /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 23 08:27:23.755560 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:23.756169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:23.763597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:23.764105 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:23.764564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:23.765256 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:23.765740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:23.766201 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:23.900527 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:23.909767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:23.911409 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:23.912558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f7242d74-7287-40fd-8126-ac365e237180 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1670 microversion: 2.20 time: 0.160933 Aug 23 08:27:23.913136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 431/892] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:23 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:24.935978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:24.937106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:24.943106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:24.948099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:24.948099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:24.948099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:24.948099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:24.948478 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:25.104474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:25.114654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:25.131131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:25.131131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a36724fc-d56c-442f-b05b-7e4f9b83a51c tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1670 microversion: 2.20 time: 0.186315 Aug 23 08:27:25.131131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 462/893] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:24 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1670 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:26.143045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:26.143659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:26.149605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:26.150095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:26.150531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:26.151320 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:26.151776 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:26.152213 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:26.368094 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:26.376424 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:26.378017 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:26.379216 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f7590367-4298-495b-8e68-ab88a2ee5e54 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.240201 Aug 23 08:27:26.379783 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 432/894] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:26 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:27.198405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27909906-2a55-4142-aa77-2eaccba26e06"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:27:27.200938 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:27.208519 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:27.209008 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:27.209449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:27.210146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:27.210603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:27.211051 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:27.402371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:27.403740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:27.410765 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:27.411609 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:27.412300 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:27.413224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:27.413899 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:27.414543 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:27.606759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:27.616240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:27.617920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:27.619316 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c5791d11-8175-4fe7-aac7-8707fb654b8d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.220755 Aug 23 08:27:27.623062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 433/895] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:27 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:28.643627 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:28.644314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:28.650752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:28.651305 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:28.651757 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:28.652436 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:28.652890 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:28.653313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:28.793545 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:28.802356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:28.804021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:28.805247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-544e841f-6d39-4504-a386-74d66886c631 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.166092 Aug 23 08:27:28.806041 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 434/896] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:28 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:29.828629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:29.829299 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:29.835859 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:29.836365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:29.836790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:29.837491 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:29.837951 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:29.838374 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:29.975298 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:29.984626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:29.986146 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:29.987372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3a099ceb-8af6-41a1-805b-1122ea737485 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.162681 Aug 23 08:27:29.987962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 435/897] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:29 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:31.012632 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:31.013503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:31.020313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:31.020887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:31.021413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:31.022175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:31.022748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:31.023217 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:31.164524 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:31.173130 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:31.174661 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:31.175858 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f181ec4c-cb45-42b7-a810-ccc836e5b79a tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.169201 Aug 23 08:27:31.176601 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 436/898] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:31 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:32.199395 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:32.200028 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:32.208425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:32.209367 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:32.209962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:32.210821 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:32.211305 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:32.211821 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:32.363604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:32.371976 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:32.373494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:32.374714 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-32ee7aa9-dbb5-4c80-bf0c-56e1f02a3aae tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.179465 Aug 23 08:27:32.383389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 437/899] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:32 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:33.399032 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:33.399901 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:33.406905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:33.407464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:33.407897 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:33.408741 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:33.409193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:33.409637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:33.543687 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:33.555140 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:33.556834 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:33.558060 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-476cc414-8326-4ad3-a9ea-242bfbd5ea83 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.164102 Aug 23 08:27:33.573555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 438/900] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:33 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:34.583441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:34.584773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:34.595486 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:34.596116 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:34.596712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:34.597612 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:34.598169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:34.598689 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:34.771850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:34.781637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:34.783322 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:34.784532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d04fd4d7-c515-4a87-9e8f-0cc53a700ea3 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.207175 Aug 23 08:27:34.785457 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 439/901] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:34 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:35.807767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:35.808380 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:35.815511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:35.815999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:35.816441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:35.817133 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:35.817589 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:35.818019 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:35.944307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:35.952420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:35.953937 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:35.955447 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0230e8fc-f54f-44fe-8b9b-6acfa981d45e tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.151240 Aug 23 08:27:35.956014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 440/902] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:35 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:36.978729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:36.979359 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:36.985645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:36.986122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:36.986552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:36.987264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:36.987716 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:36.990581 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:36.992144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:37.116239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:37.124464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:37.126518 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:37.127700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-57c6a0cf-eb17-405e-9dcf-5c11253522cb tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.152790 Aug 23 08:27:37.128282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 441/903] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:36 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:37.206231 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:37.319233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:38.150292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:38.150903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:38.158697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:38.159679 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:38.159679 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:38.160354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:38.160818 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:38.161240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:38.293501 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:38.303430 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:38.304948 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:38.306141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-42f9099a-fbaf-48ec-a351-f367fbc67ae4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.159842 Aug 23 08:27:38.306702 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 442/904] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:38 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:39.328881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:39.329552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:39.336290 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:39.336780 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:39.337219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:39.337911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:39.338370 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:39.338796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:39.464023 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:39.472686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:39.474203 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:39.475454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-392853e0-7326-4a68-930c-5087c4a16df1 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.151017 Aug 23 08:27:39.476021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 443/905] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:39 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:40.498154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:40.499059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:40.505750 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:40.506237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:40.506709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:40.507442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:40.507902 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:40.508398 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:40.648370 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:40.656725 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:40.658228 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:40.659416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-956c4f14-3e00-411d-bd00-ce60269bb5c2 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.165717 Aug 23 08:27:40.660007 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 444/906] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:40 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:41.588343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6ef72c4c-74fa-41ad-bfc4-ae4f60f44511 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.393780 Aug 23 08:27:41.588939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 463/907] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:27:27 2022] POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/os-volume_attachments => generated 194 bytes in 14395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:27:41.683110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:41.685085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:41.689915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:41.690397 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:41.690829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:41.691541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:41.691992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:41.692408 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:41.824211 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:41.833450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:41.834997 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:41.836148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-54a5f1c3-5af1-498a-81e2-42cc2f37b0f0 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.157660 Aug 23 08:27:41.836704 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 445/908] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:41 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:42.861651 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:42.862457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:42.869214 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:42.869697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:42.870129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:42.870818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:42.871306 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:42.871728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:43.001778 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:43.010294 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:43.011887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:43.013054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-86061f90-8700-406c-ad8d-1bc8fa41dd18 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.156820 Aug 23 08:27:43.013680 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 464/909] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:42 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 08:27:43.209678 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-1483e023-1fde-4d94-82c2-8d020c981aa8 req-b3aa8ea8-2a6d-4091-a2f8-36af72b06fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c", "name": "network-vif-plugged", "status": "completed", "tag": "8e36973f-5869-4694-b64a-1171d88a8a97"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:27:43.220626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-1483e023-1fde-4d94-82c2-8d020c981aa8 req-b3aa8ea8-2a6d-4091-a2f8-36af72b06fa1 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:43.221261 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-1483e023-1fde-4d94-82c2-8d020c981aa8 req-b3aa8ea8-2a6d-4091-a2f8-36af72b06fa1 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:43.221703 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-1483e023-1fde-4d94-82c2-8d020c981aa8 req-b3aa8ea8-2a6d-4091-a2f8-36af72b06fa1 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:43.232506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-1483e023-1fde-4d94-82c2-8d020c981aa8 req-b3aa8ea8-2a6d-4091-a2f8-36af72b06fa1 service nova] Creating event network-vif-plugged:8e36973f-5869-4694-b64a-1171d88a8a97 for instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c on hv-cinder-85407 Aug 23 08:27:43.237390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-1483e023-1fde-4d94-82c2-8d020c981aa8 req-b3aa8ea8-2a6d-4091-a2f8-36af72b06fa1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Aug 23 08:27:43.237967 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 446/910] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:27:44.040385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:44.040997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:44.047884 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:44.048370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:44.048807 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:44.049494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:44.049947 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:44.050371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:44.178474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:44.186602 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:44.188396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:44.189337 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9b1f182a-09b6-42ac-a94b-bb02b33c362d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.152918 Aug 23 08:27:44.189877 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 465/911] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:44 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:45.213083 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:45.213788 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:45.220034 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:45.220516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:45.220952 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:45.221642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:45.222099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:45.222526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:45.353323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:45.361845 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:45.363366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:45.364506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-69fa2a34-dc33-4986-af21-4dbb5868a6e9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.156336 Aug 23 08:27:45.365059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 447/912] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:45 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:46.387831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:46.388430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:46.395452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:46.395935 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:46.396373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:46.397057 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:46.397515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:46.397938 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:46.527800 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:46.536145 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:46.537658 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:46.538823 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7354f104-a7a6-45c7-a493-cdbb4d275138 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1728 microversion: 2.20 time: 0.155135 Aug 23 08:27:46.539404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 466/913] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:46 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:47.561773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:47.562389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:47.564815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=42 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:27:47.569631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:47.570166 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:47.570605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:47.571403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:47.571865 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:47.572294 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:47.701165 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:47.709917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:47.711445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:47.712586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-977f1632-8b3d-431d-a070-8ccf118bb329 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1715 microversion: 2.20 time: 0.154813 Aug 23 08:27:47.713159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 448/914] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:27:47 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1715 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:27:50.333339 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-95920f19-5d19-4f05-bfaf-2c1a765a445e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:27:50.339637 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95920f19-5d19-4f05-bfaf-2c1a765a445e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:50.340111 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95920f19-5d19-4f05-bfaf-2c1a765a445e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:50.340536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95920f19-5d19-4f05-bfaf-2c1a765a445e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:50.397755 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-95920f19-5d19-4f05-bfaf-2c1a765a445e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Going to try to stop instance {{(pid=121382) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 08:27:50.574808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-95920f19-5d19-4f05-bfaf-2c1a765a445e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/action" status: 202 len: 0 microversion: 2.1 time: 0.245161 Aug 23 08:27:50.575411 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 467/915] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:27:50 2022] POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:27:50.584033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:50.584652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:50.591271 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:50.591796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:50.592302 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:50.593001 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:50.593463 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:50.593895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:50.722471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:50.730562 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-17a1f64e-6438-407c-a2ca-c9f7eaba75ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.150424 Aug 23 08:27:50.731156 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 449/916] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:50 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:27:51.752683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:51.753381 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:51.759620 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:51.760108 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:51.760549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:51.761250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:51.761704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:51.762130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:51.891055 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:51.899180 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ea9839e3-6686-4292-b573-8dc7540ece8f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.151697 Aug 23 08:27:51.899770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 468/917] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:51 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:27:52.919663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:52.920270 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:52.926831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:52.927343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:52.927788 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:52.928469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:52.928928 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:52.929362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:53.057334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:53.065554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-39232e6e-b05f-4ab4-a929-36de84672804 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.149747 Aug 23 08:27:53.066124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 450/918] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:52 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:27:54.087479 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:54.088021 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:54.094549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:54.095090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:54.095533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:54.096229 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:54.096689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:54.097120 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:54.230449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:54.239247 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f8aa3ad2-88bb-4a38-bb48-e6d7a7e2e4c0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.155813 Aug 23 08:27:54.239818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 469/919] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:54 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:27:55.259455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:55.260063 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:55.266429 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:55.266916 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:55.267374 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:55.268052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:55.268503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:55.268921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:55.399444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:55.408074 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-41ee4215-38a8-4f97-9344-3b479d030331 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.152522 Aug 23 08:27:55.408636 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 451/920] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:55 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:27:56.428759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:56.429338 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:56.435775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:56.436771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:56.437204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:56.437892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:56.438370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:56.438793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:56.565424 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:56.573881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-08f35a87-acb4-46a0-aa59-bb0e36bdd2ee tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.149030 Aug 23 08:27:56.574444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 470/921] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:56 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:27:57.594887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:57.595571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:57.601796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:57.602285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:57.602724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:57.603448 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:57.603909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:57.604340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:57.731472 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:57.740156 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1e8138fb-d15a-4f17-8146-9793a5b53fca tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.149275 Aug 23 08:27:57.740728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 452/922] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:57 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:27:58.760213 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:58.760865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:58.767835 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:58.768318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:58.768751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:58.769438 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:58.769889 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:58.770311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:58.899530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:27:58.908378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7c27c712-ffee-444b-8377-a3392a20ab24 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.152086 Aug 23 08:27:58.908945 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 471/923] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:58 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:27:59.928647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:27:59.929249 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:27:59.936121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:59.936594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:59.937023 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:27:59.937706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:27:59.938170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:27:59.938570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:00.215084 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:00.223774 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c7115dbc-a663-4d8a-ba69-e820a58f1e29 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.298991 Aug 23 08:28:00.224342 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 453/924] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:27:59 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:01.244754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:01.245375 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:01.252422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:01.252907 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:01.253372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:01.254064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:01.254523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:01.254965 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:01.384871 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:01.393430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f8fe4557-1e26-40a1-bcd6-ae8824ceeb44 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.152574 Aug 23 08:28:01.393981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 472/925] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:01 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:02.414735 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:02.415399 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:02.422510 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:02.423030 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:02.423495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:02.424183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:02.424638 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:02.425062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:02.549412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:02.557771 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f700e949-6b6a-4ffb-9b1c-ba292ee06bab tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.146866 Aug 23 08:28:02.558328 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 454/926] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:02 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:03.580348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:03.580962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:03.587336 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:03.587841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:03.588280 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:03.588970 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:03.589430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:03.589862 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:03.720065 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:03.728276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ff442ad1-27b0-4760-b06b-153d890894f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.152730 Aug 23 08:28:03.728846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 473/927] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:03 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:04.749206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:04.749923 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:04.756326 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:04.756809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:04.757235 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:04.757918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:04.758373 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:04.758791 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:04.884411 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:04.893093 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3232a428-0b95-4736-9746-b009aa0aa138 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.147782 Aug 23 08:28:04.893766 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 455/928] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:04 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:05.914582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:05.915223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:05.921669 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:05.922152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:05.922589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:05.923350 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:05.923810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:05.924238 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:06.049017 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:06.057196 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3fc0f591-b5bc-416f-a37a-0dead7c74d50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.146520 Aug 23 08:28:06.057767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 474/929] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:05 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:07.078824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:07.079382 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:07.085801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:07.086292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:07.086735 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:07.087467 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:07.087934 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:07.088494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:07.220005 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:07.228239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-016df746-ab75-46e2-b48c-c05c1ebb9dcc tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.153694 Aug 23 08:28:07.228815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 456/930] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:07 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:08.249530 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:08.250135 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:08.252629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=23 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:08.257215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:08.257695 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:08.258124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:08.258805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:08.259277 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:08.259695 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:08.263500 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:08.388298 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:08.396313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7ff9fe11-2ff7-4991-899f-7239ddb621f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.150628 Aug 23 08:28:08.396874 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 475/931] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:08 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:09.417587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:09.418203 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:09.424688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:09.425175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:09.425612 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:09.426305 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:09.426763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:09.427388 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:09.430386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=91 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:09.557238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:09.565474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c1cd9945-678c-4710-8c74-a60b7185c89d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.151786 Aug 23 08:28:09.566041 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 457/932] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:09 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:09.736702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:28:09.737229 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:09.743627 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:09.744119 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:09.744551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:09.745234 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:09.745689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:09.746141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:09.769301 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lazy-loading 'flavor' on Instance uuid a50f4b20-cc8e-40bf-925f-823811815d70 {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:28:10.082634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bc7bbec2-d137-44b9-b4d9-bafdece296a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "POST /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70/action" status: 202 len: 0 microversion: 2.1 time: 0.349856 Aug 23 08:28:10.083171 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 476/933] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:28:09 2022] POST /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:28:10.091497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:10.095579 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:10.097983 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:10.098471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:10.098913 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:10.099630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:10.100086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:10.100510 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:10.235691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:10.243608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bcd7a5a9-127b-4132-abb2-23596fd5ae2f tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.156033 Aug 23 08:28:10.244177 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 458/934] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:10 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:10.587009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:10.587871 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:10.594744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:10.595295 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:10.595787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:10.596517 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:10.596977 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:10.597404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:10.724022 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:10.732842 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a12746a9-384b-450d-aa15-fb69d1b9a0af tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.150122 Aug 23 08:28:10.733409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 477/935] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:10 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:11.266004 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:11.266607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:11.272999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:11.273481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:11.273913 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:11.274598 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:11.275092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:11.275517 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:11.410568 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:11.418209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-fd9e25a0-78f0-454b-a308-42e152c97ac5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.156851 Aug 23 08:28:11.418761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 459/936] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:11 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:11.753693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:11.754293 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:11.760886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:11.761380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:11.761850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:11.762591 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:11.763082 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:11.763509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:11.889618 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:11.897860 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c3f8cec4-b9e0-421e-a902-4c84a82873f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.148062 Aug 23 08:28:11.898429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 478/937] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:11 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:12.440909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:12.441623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:12.448611 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:12.449130 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:12.450146 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:12.451103 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:12.451884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:12.452477 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:12.588252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:12.596819 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-29574413-693b-43df-9f20-653048c80a11 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.161318 Aug 23 08:28:12.599812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 460/938] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:12 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:12.919005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:12.919646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:12.926014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:12.926504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:12.926949 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:12.927650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:12.928102 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:12.928525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:13.058810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:13.067862 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-39e04bb3-2f30-4836-9322-aa400ca1a290 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.152700 Aug 23 08:28:13.068448 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 479/939] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:12 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:13.618269 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:13.619181 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:13.625496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:13.625980 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:13.626418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:13.627134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:13.627592 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:13.628016 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:13.758471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:13.767442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f02718de-f932-487a-bfab-b48e52e59f21 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.153040 Aug 23 08:28:13.768007 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 461/940] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:13 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:14.088338 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:14.088972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:14.095864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:14.096342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:14.096771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:14.097447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:14.097907 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:14.098313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:14.230858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:14.239018 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c01ec152-4320-44b4-a465-c85736399312 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.154524 Aug 23 08:28:14.239589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 480/941] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:14 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:28:14.788318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:14.788928 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:14.795829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:14.796312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:14.796740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:14.797427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:14.797881 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:14.798303 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:14.926312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:14.933995 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6d6d094e-6c87-47a1-a63e-3dddf5463841 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.149515 Aug 23 08:28:14.934559 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 462/942] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:14 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:15.260607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:15.261221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:15.268455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:15.268978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:15.269483 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:15.270220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:15.270711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:15.271189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:15.406784 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:15.414982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bc695668-f6c9-4cd6-8d73-77070ddd6ad8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.158246 Aug 23 08:28:15.415548 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 481/943] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:15 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:15.955468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:15.956086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:15.962473 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:15.962985 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:15.963430 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:15.964122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:15.964582 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:15.965520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:16.099340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:16.108334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-48c45bf1-f53d-4f40-986d-debd7a0b0695 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.157025 Aug 23 08:28:16.108915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 463/944] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:15 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:16.435773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:16.436455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:16.442641 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:16.443145 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:16.443575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:16.444251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:16.444697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:16.445112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:16.572723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:16.581773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-75036b2b-0fe3-4779-98b2-9a4b71ba9ee5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.150347 Aug 23 08:28:16.582335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 482/945] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:16 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:28:17.129621 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:17.130184 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:17.136471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:17.136962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:17.137403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:17.138101 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:17.138550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:17.139069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:17.270368 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:17.278593 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8a779662-785e-494f-9056-27d2ae3579bd tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.152920 Aug 23 08:28:17.279194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 464/946] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:17 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:17.603150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:17.603767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:17.610296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:17.610773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:17.612863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:17.612863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:17.612863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:17.612863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:17.738119 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:17.746336 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-72a79c80-8448-4fff-8078-80e8b84943d2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.147263 Aug 23 08:28:17.746964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 483/947] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:17 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:18.299787 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:18.300398 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:18.302663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=34 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:18.307332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:18.307823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:18.308917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:18.309994 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:18.314064 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:18.316346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:18.526150 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:18.533957 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-05a36d05-6b78-4244-bf0e-122fa9a5f324 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.238065 Aug 23 08:28:18.534532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 465/948] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:18 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:18.767321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:18.767929 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:18.774383 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:18.774804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:18.775271 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:18.775986 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:18.776443 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:18.777364 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:18.903027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:18.912066 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-065a71cc-6b94-4ec1-be2a-e95336bc319f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.148724 Aug 23 08:28:18.912647 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 484/949] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:18 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:19.556247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:19.556853 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:19.563709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:19.564217 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:19.564648 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:19.565326 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:19.565777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:19.566191 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:19.695878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:19.704621 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-eca51130-833d-470d-af62-b0f0ad309b72 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.152240 Aug 23 08:28:19.705174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 466/950] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:19 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:19.934216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:19.934824 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:19.941174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:19.941658 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:19.942089 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:19.942774 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:19.943252 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:19.943678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:20.070170 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:20.078565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-01eb2ab1-814a-4769-974e-26f8d6afd734 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.148880 Aug 23 08:28:20.079161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 485/951] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:19 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:20.725649 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:20.726335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:20.732773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:20.733263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:20.733706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:20.734454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:20.734921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:20.735379 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:21.099868 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:21.100658 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:21.107429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:21.110267 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:21.110267 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:21.110267 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:21.110267 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:21.110784 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:21.231340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:21.241018 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c35f85ad-edd8-4e3e-a606-3960fe393e62 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.519208 Aug 23 08:28:21.242116 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 467/952] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:20 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:21.314652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:21.323048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c5a423c2-2b37-4b46-b4ff-1ce4591e1889 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1723 microversion: 2.1 time: 0.227369 Aug 23 08:28:21.323706 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 486/953] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:21 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:28:22.264403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:22.265073 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:22.272136 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:22.272686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:22.273163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:22.273927 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:22.274436 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:22.274890 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:22.345494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:22.346128 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:22.353317 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:22.353454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:22.353877 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:22.355205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:22.355691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:22.356122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:22.440777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:22.449186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-39228b67-7276-4e45-b0d1-c5142be7b0f7 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.189131 Aug 23 08:28:22.449753 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 468/954] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:22 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:22.499404 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:22.508313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0f7e9ff5-3ad4-4c30-9164-081820da32d3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1700 microversion: 2.1 time: 0.167526 Aug 23 08:28:22.508948 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 487/955] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:22 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1700 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:28:22.529605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-73ff58ac-bec0-4f18-85e4-9f8e7ddcaaa9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:28:22.535885 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73ff58ac-bec0-4f18-85e4-9f8e7ddcaaa9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:22.536370 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73ff58ac-bec0-4f18-85e4-9f8e7ddcaaa9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:22.536858 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-73ff58ac-bec0-4f18-85e4-9f8e7ddcaaa9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:22.597813 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-73ff58ac-bec0-4f18-85e4-9f8e7ddcaaa9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Going to try to start instance {{(pid=121383) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 08:28:22.737058 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-73ff58ac-bec0-4f18-85e4-9f8e7ddcaaa9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/action" status: 202 len: 0 microversion: 2.1 time: 0.211830 Aug 23 08:28:22.737583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 469/956] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:28:22 2022] POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:28:22.745809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:22.751190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:22.752802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:22.753344 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:22.753811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:22.754747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:22.755315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:22.755794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:22.888695 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:22.895628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5a4bfb78-4e2e-4006-92e7-5eb80ccb226e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1709 microversion: 2.1 time: 0.153756 Aug 23 08:28:22.896197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 488/957] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:22 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:23.471637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:23.472358 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:23.478586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:23.479106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:23.480184 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:23.480877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:23.481413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:23.481751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:23.684469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:23.692416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0f28f9b7-e5a1-4af3-b679-7d452313c5a9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.225641 Aug 23 08:28:23.692988 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 470/958] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:23 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:23.917903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:23.918513 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:23.924903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:23.927555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:23.927555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:23.927555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:23.927555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:23.927906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:24.058527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:24.060867 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:24.067897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f30c4c78-cc61-4985-bcea-1d102067baae tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1709 microversion: 2.1 time: 0.153803 Aug 23 08:28:24.068617 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 489/959] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:23 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:24.714710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:24.715366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:24.721889 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:24.722369 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:24.722803 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:24.723648 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:24.724108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:24.724537 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:24.856791 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:24.864591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2cf188db-079e-4103-9eff-67c889b0d58b tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1508 microversion: 2.1 time: 0.153708 Aug 23 08:28:24.865153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 471/960] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:24 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:24.885265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:28:24.886510 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:24.893206 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:24.893689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:24.894148 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:24.894835 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:24.895322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:24.895747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:24.929574 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121382) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 08:28:25.089278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:25.089810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:25.095867 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:25.096361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:25.096800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:25.097495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:25.097975 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:25.098455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:25.224953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:25.227366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:25.234560 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-51bac7c0-a917-449f-b8c2-521560598ecd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1713 microversion: 2.1 time: 0.149330 Aug 23 08:28:25.235160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 472/961] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:25 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:28:25.289990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1b35a6a1-503f-473f-86f3-f74576e4dbd0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "POST /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70/action" status: 202 len: 0 microversion: 2.1 time: 0.408668 Aug 23 08:28:25.290637 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 490/962] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:28:24 2022] POST /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:28:25.299515 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:25.304196 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:25.306523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:25.307038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:25.308036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:25.308795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:25.309260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:25.309685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:25.441821 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:25.449846 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3d4ef6f5-0da2-411f-b275-654f0b9d4ebf tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1516 microversion: 2.1 time: 0.154534 Aug 23 08:28:25.450426 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 473/963] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:25 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:26.472389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:26.473032 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:26.479720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:26.480250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:26.480686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:26.481377 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:26.481829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:26.482258 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:26.618048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:26.625935 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e8a25e6b-d161-4ca8-9681-309ed63c561d tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1516 microversion: 2.1 time: 0.157895 Aug 23 08:28:26.626502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 491/964] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:26 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:27.354971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-2a2f6310-137f-4fe0-bd2f-87807b0f572e req-6e861d28-5e1f-41f1-974c-7daa5cc00dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50f4b20-cc8e-40bf-925f-823811815d70", "name": "network-vif-unplugged", "status": "completed", "tag": "12c59a69-5657-4426-9266-ea6ab28bbd96"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:28:27.364366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-2a2f6310-137f-4fe0-bd2f-87807b0f572e req-6e861d28-5e1f-41f1-974c-7daa5cc00dc6 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:27.364846 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-2a2f6310-137f-4fe0-bd2f-87807b0f572e req-6e861d28-5e1f-41f1-974c-7daa5cc00dc6 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:27.365276 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-2a2f6310-137f-4fe0-bd2f-87807b0f572e req-6e861d28-5e1f-41f1-974c-7daa5cc00dc6 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:27.377144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.compute.server_external_events [req-2a2f6310-137f-4fe0-bd2f-87807b0f572e req-6e861d28-5e1f-41f1-974c-7daa5cc00dc6 service nova] Unable to find a host for instance a50f4b20-cc8e-40bf-925f-823811815d70. Dropping event network-vif-unplugged {{(pid=121383) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 08:28:27.378004 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-2a2f6310-137f-4fe0-bd2f-87807b0f572e req-6e861d28-5e1f-41f1-974c-7daa5cc00dc6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.080310 Aug 23 08:28:27.378570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 474/965] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 82 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 23 08:28:27.647506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:27.648119 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:27.655077 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:27.655557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:27.655993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:27.656684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:27.657138 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:27.657559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:27.788290 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:27.796728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-292d84b4-0509-4b64-b8d9-5e9963bfcaa6 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1516 microversion: 2.1 time: 0.153048 Aug 23 08:28:27.797291 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 492/966] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:27 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:28.817795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:28.818418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:28.825091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:28.825583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:28.826020 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:28.826986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:28.827479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:28.827956 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:28.959316 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:28.966877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3ba99fda-0f51-4dc4-add4-820c402ec1fc tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1516 microversion: 2.1 time: 0.153069 Aug 23 08:28:28.967465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 475/967] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:28 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:29.988146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:29.988759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:29.995294 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:29.995777 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:29.996728 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:29.997425 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:29.997881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:29.998307 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:30.127950 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:30.133514 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-10974eeb-afff-41c7-ab6e-9e96fc646608 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1516 microversion: 2.1 time: 0.149369 Aug 23 08:28:30.134077 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 493/968] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:29 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:28:31.156039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:31.156625 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:31.162969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:31.163435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:31.163863 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:31.164544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:31.165001 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:31.165419 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:31.296959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:31.304739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-30f8930c-9a74-4274-9840-aa3616995be8 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1518 microversion: 2.1 time: 0.153188 Aug 23 08:28:31.305496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 476/969] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:31 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:32.326555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:32.327197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:32.333515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:32.334001 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:32.334439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:32.335178 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:32.335638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:32.336126 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:32.474326 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:32.482477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-25a43e59-2dca-40a3-9cfb-76b3cfd0f041 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.160785 Aug 23 08:28:32.483063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 494/970] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:32 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:33.503416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:33.504032 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:33.510646 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:33.511170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:33.512106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:33.512801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:33.513263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:33.513691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:33.650402 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:33.658332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-580e3e59-8d72-4b2e-85f2-ab47fb218eea tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.158809 Aug 23 08:28:33.658899 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 477/971] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:33 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:34.679648 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:34.680254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:34.686651 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:34.687158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:34.687612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:34.688290 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:34.688768 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:34.689188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:34.817103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:34.825323 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e431aac8-def8-48a7-9968-21f842548651 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.149595 Aug 23 08:28:34.825884 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 495/972] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:34 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:35.847153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:35.847698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:35.854161 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:35.854653 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:35.855123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:35.855820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:35.856282 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:35.856712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:35.987476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:35.995367 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b4e0b829-009c-43b7-ae79-cd4750b5f053 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.152168 Aug 23 08:28:35.995925 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 478/973] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:35 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:37.017526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:37.018122 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:37.024720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:37.025201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:37.025632 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:37.026321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:37.026776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:37.027230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:37.157398 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:37.165039 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b6790b59-4c77-46ec-a9b8-b9f923d63c2a tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.152112 Aug 23 08:28:37.165606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 496/974] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:37 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:38.187144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:38.187754 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:38.194144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:38.194624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:38.195084 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:38.200410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:38.200410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:38.200410 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:38.327115 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:38.334688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-82a6a48e-92f1-40be-8aa6-7f8789c0d937 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.152134 Aug 23 08:28:38.335492 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 479/975] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:38 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:39.356211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:39.356864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:39.359227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:39.364041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:39.364528 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:39.364981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:39.365697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:39.366146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:39.366564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:39.500136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:39.507788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9ee02de4-2827-449b-9bdc-529a41831ba9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.155506 Aug 23 08:28:39.508345 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 497/976] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:39 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:40.529512 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:40.530128 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:40.537157 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:40.537782 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:40.538285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:40.539014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:40.539479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:40.539908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:40.670760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:40.678566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8e1a4a0a-18c8-4a24-b0cd-0684c38a0a92 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.152902 Aug 23 08:28:40.679169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 480/977] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:40 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:41.699408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:41.700825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:41.707511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:41.707996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:41.708425 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:41.709113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:41.709570 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:41.709996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:41.843729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:41.851431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a6735143-6cb0-4e33-9ac6-ebe0960afdb2 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.155853 Aug 23 08:28:41.852003 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 498/978] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:41 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:42.872571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:42.873184 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:42.879689 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:42.880179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:42.880619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:42.881315 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:42.881777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:42.882206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:43.011370 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:43.019198 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-baecfbc7-3dc3-4eb0-81ca-211351bcc624 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.150582 Aug 23 08:28:43.019762 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 481/979] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:42 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:43.260855 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:43.263235 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:43.269261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:43.269818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:43.270347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:43.271145 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:43.271682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:43.272182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:43.302333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-918ce608-4f30-4480-953d-b5fcfba67292 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045634 Aug 23 08:28:43.303018 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 499/980] 10.222.0.58 () {60 vars in 1343 bytes} [Tue Aug 23 08:28:43 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:28:43.364842 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:43.365342 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:43.371197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:43.372451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:43.372940 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:43.373663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:43.374170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:43.374759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:43.399630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:28:43.410923 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-187d50a7-72cb-429e-8021-327ee978d690 req-bf5a498f-98bc-40b2-8ba9-4a3bbc0c10fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50f4b20-cc8e-40bf-925f-823811815d70", "name": "network-vif-plugged", "status": "completed", "tag": "12c59a69-5657-4426-9266-ea6ab28bbd96"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:28:43.420741 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-187d50a7-72cb-429e-8021-327ee978d690 req-bf5a498f-98bc-40b2-8ba9-4a3bbc0c10fb service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:43.421225 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-187d50a7-72cb-429e-8021-327ee978d690 req-bf5a498f-98bc-40b2-8ba9-4a3bbc0c10fb service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:43.421659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-187d50a7-72cb-429e-8021-327ee978d690 req-bf5a498f-98bc-40b2-8ba9-4a3bbc0c10fb service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:43.432711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-187d50a7-72cb-429e-8021-327ee978d690 req-bf5a498f-98bc-40b2-8ba9-4a3bbc0c10fb service nova] Creating event network-vif-plugged:12c59a69-5657-4426-9266-ea6ab28bbd96 for instance a50f4b20-cc8e-40bf-925f-823811815d70 on hv-cinder-85407 Aug 23 08:28:43.438750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-187d50a7-72cb-429e-8021-327ee978d690 req-bf5a498f-98bc-40b2-8ba9-4a3bbc0c10fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031554 Aug 23 08:28:43.439411 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 500/981] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:28:43.721492 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5e06f8ff-5e9a-4e71-b064-4b1425e02584 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 204 len: 0 microversion: 2.20 time: 0.360241 Aug 23 08:28:43.722128 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 482/982] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Aug 23 08:28:43 2022] DELETE /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 08:28:43.731638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:43.732377 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:43.738682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:43.739198 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:43.739648 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:43.740351 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:43.740986 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:43.741409 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:43.871371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:43.882883 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:43.882883 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:43.882883 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8cf79960-074c-4f9d-95a6-f4e656f5ec8b tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.156232 Aug 23 08:28:43.883547 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 501/983] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:28:43 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:28:44.041700 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:44.042353 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:44.049576 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:44.050060 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:44.050503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:44.051238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:44.051698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:44.052126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:44.188295 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:44.196156 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-953fcb40-a711-4001-b68e-50a20497da61 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.159022 Aug 23 08:28:44.196721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 483/984] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:44 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:44.905621 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:44.906224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:44.912806 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:44.913296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:44.913730 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:44.914427 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:44.914881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:44.915335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:45.073515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:45.082047 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:45.083650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:45.084813 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d1131fda-67cd-4291-ac71-1a49d65a66d4 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.183162 Aug 23 08:28:45.085373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 502/985] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:28:44 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:28:45.218111 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:45.218724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:45.225169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:45.225655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:45.226099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:45.226794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:45.227289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:45.227721 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:45.358899 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:45.366534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3ec6a73c-a3a4-4f9f-b78b-e35b5d03a450 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.152903 Aug 23 08:28:45.367120 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 484/986] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:45 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:46.107477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:46.108089 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:46.114588 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:46.115110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:46.115557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:46.116248 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:46.116705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:46.117135 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:46.329524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:46.337659 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:46.339200 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:46.340358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c3e7f7b5-63e4-4354-ac90-2ec68144b571 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1721 microversion: 2.20 time: 0.236809 Aug 23 08:28:46.340917 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 503/987] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:28:46 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:28:46.386952 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:46.387718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:46.394189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:46.394678 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:46.395154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:46.395850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:46.396310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:46.396743 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:46.652982 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:46.661341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-34bc8c36-dac4-4da6-bc1d-11ac37e59c49 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1574 microversion: 2.1 time: 0.278328 Aug 23 08:28:46.667069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 485/988] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:46 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1574 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:47.238343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-492323a8-c946-4f0c-b6d6-34a882e4fe93 req-80b0e6ea-15b8-46ea-b468-90768672f19c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c", "name": "network-vif-deleted", "tag": "8e36973f-5869-4694-b64a-1171d88a8a97"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:28:47.251620 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-492323a8-c946-4f0c-b6d6-34a882e4fe93 req-80b0e6ea-15b8-46ea-b468-90768672f19c service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:47.252104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-492323a8-c946-4f0c-b6d6-34a882e4fe93 req-80b0e6ea-15b8-46ea-b468-90768672f19c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:47.252541 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-492323a8-c946-4f0c-b6d6-34a882e4fe93 req-80b0e6ea-15b8-46ea-b468-90768672f19c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:47.265017 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-492323a8-c946-4f0c-b6d6-34a882e4fe93 req-80b0e6ea-15b8-46ea-b468-90768672f19c service nova] Creating event network-vif-deleted:8e36973f-5869-4694-b64a-1171d88a8a97 for instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c on hv-cinder-85407 Aug 23 08:28:47.270670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-492323a8-c946-4f0c-b6d6-34a882e4fe93 req-80b0e6ea-15b8-46ea-b468-90768672f19c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097275 Aug 23 08:28:47.274768 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 504/989] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:28:47.364014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:47.364684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:47.371373 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:47.372793 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:47.373334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:47.374114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:47.374715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:47.375242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:47.443324 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:47.452021 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:47.461042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ce316aa5c0b54ac99ade6cc4163ee209', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc3167dc177744959760f39d57937670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:47.461042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8ab6d15a-496a-465c-847a-a9bcaca80bef tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 200 len: 1654 microversion: 2.20 time: 0.095273 Aug 23 08:28:47.461042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 486/990] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:28:47 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 1654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 08:28:47.683484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:47.684296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:47.690494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:47.690994 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:47.691426 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:47.692116 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:47.692563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:47.692982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:47.832020 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:28:47.840457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ee68e4f3-165f-45ea-94b5-216ebf82620c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1561 microversion: 2.1 time: 0.161247 Aug 23 08:28:47.844106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 505/991] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:28:47 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:28:48.478196 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:48.478729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:48.481149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:28:48.486422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:48.486910 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:48.487394 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:48.488091 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:48.488587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:48.489016 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:48.502320 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] HTTP exception thrown: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Request method failure captured: Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c HTTP/1.1 Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0FIHe0LkvA12I2JdjVdevptNjPU5DBpdwMEvseDqS0BPzVtt5Yr8g--yaD4yyghKXbsT7uJiyhveNGxp-ZMx3zPL1nnSOfP3yCtjvug2k6cyBtjVsAPJeC1jn4SraX9Dpud1ipUu5cRuEEEMA86Wy5Yunj7ttj4XGPvUhjQpEZW2s Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:28:48.504009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc3167dc177744959760f39d57937670", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc3167dc177744959760f39d57937670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: ce316aa5c0b54ac99ade6cc4163ee209 Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:48.505633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c'} Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:28:48.506434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:48.508126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:48.509626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Returning 404 to user: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:28:48.509626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0d88097e-d87c-412a-a5e0-56d519c07775 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 404 len: 111 microversion: 2.20 time: 0.031228 Aug 23 08:28:48.509626 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 487/992] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:28:48 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:28:48.514896 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1754d07b-29fb-4aaf-9d6d-0aa37b7d71b9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '.version_select at 0x7fa61a0a95e0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:48.607006 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1754d07b-29fb-4aaf-9d6d-0aa37b7d71b9 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-247155968" status: 204 len: 0 microversion: 2.20 time: 0.096228 Aug 23 08:28:48.607592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 506/993] 10.222.0.58 () {60 vars in 1259 bytes} [Tue Aug 23 08:28:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-247155968 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 08:28:48.763936 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:28:48.764148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Tue Aug 23 08:28:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:28:50.617095 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:50.617690 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:50.625291 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:50.625777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:50.626219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:50.626930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:50.627422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:50.627847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:50.640876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] HTTP exception thrown: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Request method failure captured: Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c HTTP/1.1 Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0FIHe0LkvA12I2JdjVdevptNjPU5DBpdwMEvseDqS0BPzVtt5Yr8g--yaD4yyghKXbsT7uJiyhveNGxp-ZMx3zPL1nnSOfP3yCtjvug2k6cyBtjVsAPJeC1jn4SraX9Dpud1ipUu5cRuEEEMA86Wy5Yunj7ttj4XGPvUhjQpEZW2s Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:28:50.642445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc3167dc177744959760f39d57937670", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc3167dc177744959760f39d57937670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: ce316aa5c0b54ac99ade6cc4163ee209 Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.644121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c'} Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:28:50.645187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.646663 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.648258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Returning 404 to user: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:28:50.648258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4d53f5ff-a366-4121-b4ae-08a00067b882 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 404 len: 111 microversion: 2.20 time: 0.030734 Aug 23 08:28:50.648258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 488/994] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Aug 23 08:28:50 2022] DELETE /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:28:50.652690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:50.653812 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:50.660365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:50.660847 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:50.661282 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:50.661966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:50.662421 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:50.662845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:50.676420 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] HTTP exception thrown: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Request method failure captured: Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c HTTP/1.1 Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI0FIHe0LkvA12I2JdjVdevptNjPU5DBpdwMEvseDqS0BPzVtt5Yr8g--yaD4yyghKXbsT7uJiyhveNGxp-ZMx3zPL1nnSOfP3yCtjvug2k6cyBtjVsAPJeC1jn4SraX9Dpud1ipUu5cRuEEEMA86Wy5Yunj7ttj4XGPvUhjQpEZW2s Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:28:50.678035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc3167dc177744959760f39d57937670", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc3167dc177744959760f39d57937670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: ce316aa5c0b54ac99ade6cc4163ee209 Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.679702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c'} Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:28:50.680759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. Aug 23 08:28:50.682216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:50.683666 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Returning 404 to user: Instance b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:28:50.683666 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-72e8f5d1-80f8-40c5-8204-6795c109c64d tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c" status: 404 len: 111 microversion: 2.20 time: 0.031121 Aug 23 08:28:50.683666 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 507/995] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:28:50 2022] GET /compute/v2.1/servers/b1ff595d-feb6-48e7-a2b3-a0d0b1cd3b8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:28:51.951450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:51.951931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:51.958554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:51.959068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:51.959514 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:51.960204 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:51.960662 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:51.961086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:51.974528 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] HTTP exception thrown: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Request method failure captured: Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed HTTP/1.1 Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI0FIHe0LkvA12I2JdjVdevptNjPU5DBpdwMEvseDqS0BPzVtt5Yr8g--yaD4yyghKXbsT7uJiyhveNGxp-ZMx3zPL1nnSOfP3yCtjvug2k6cyBtjVsAPJeC1jn4SraX9Dpud1ipUu5cRuEEEMA86Wy5Yunj7ttj4XGPvUhjQpEZW2s Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:28:51.976082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc3167dc177744959760f39d57937670", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc3167dc177744959760f39d57937670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: ce316aa5c0b54ac99ade6cc4163ee209 Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:51.977808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '895b9968-c8a0-4035-82f3-15a6726d65ed'} Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:28:51.978699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:51.980175 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:28:51.982354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Returning 404 to user: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:28:51.982354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5de978f2-c734-44b5-8cb5-d4bad17e5cc6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "DELETE /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 404 len: 111 microversion: 2.20 time: 0.030193 Aug 23 08:28:51.982354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 489/996] 10.222.0.58 () {60 vars in 1280 bytes} [Tue Aug 23 08:28:51 2022] DELETE /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:28:51.987806 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:28:51.988414 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] [instance: 895b9968-c8a0-4035-82f3-15a6726d65ed] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:28:51.994806 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:51.995317 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:51.995751 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:51.996440 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:28:51.996892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:28:51.997313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:28:52.010261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] HTTP exception thrown: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Request method failure captured: Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed HTTP/1.1 Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI0FIHe0LkvA12I2JdjVdevptNjPU5DBpdwMEvseDqS0BPzVtt5Yr8g--yaD4yyghKXbsT7uJiyhveNGxp-ZMx3zPL1nnSOfP3yCtjvug2k6cyBtjVsAPJeC1jn4SraX9Dpud1ipUu5cRuEEEMA86Wy5Yunj7ttj4XGPvUhjQpEZW2s Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:28:52.011775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bc3167dc177744959760f39d57937670", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bc3167dc177744959760f39d57937670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bc3167dc177744959760f39d57937670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: bc3167dc177744959760f39d57937670 Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1746173114 Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: ce316aa5c0b54ac99ade6cc4163ee209 Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1746173114-project Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:52.013527 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '895b9968-c8a0-4035-82f3-15a6726d65ed'} Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:28:52.014595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. Aug 23 08:28:52.016141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:28:52.017565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] Returning 404 to user: Instance 895b9968-c8a0-4035-82f3-15a6726d65ed could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:28:52.017565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-be29404a-2bf9-49a8-9a64-ca3a9905a0d6 tempest-AttachVolumeShelveTestJSON-1746173114 tempest-AttachVolumeShelveTestJSON-1746173114-project] 10.222.0.58 "GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed" status: 404 len: 111 microversion: 2.20 time: 0.029254 Aug 23 08:28:52.017565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 508/997] 10.222.0.58 () {60 vars in 1277 bytes} [Tue Aug 23 08:28:51 2022] GET /compute/v2.1/servers/895b9968-c8a0-4035-82f3-15a6726d65ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:29:03.056351 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=5 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:03.057525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:03.165742 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2a31e5bd-55d3-4f21-89b0-8758d28cfb1b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: .version_select at 0x7fa619f3a4c0>, body: {"keypair": {"name": "tempest-keypair-567189582", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQqWcjbgu30Z73Ail44rati/PbpR/8hAEvPQkABfZQOVd3WlvJ9gRUA70armPbGHbFciq0p7pZgwoz3b2+4FXO8z+Mgx+45rA6ZjNh13IcmpVDz/AESyEBgvqKVMz+cyQ=="}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:29:03.181934 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-2a31e5bd-55d3-4f21-89b0-8758d28cfb1b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for project 1367659f7d6a404393adca1c5d713c99. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:29:03.186354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-2a31e5bd-55d3-4f21-89b0-8758d28cfb1b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for user d780debf950447b983dc94edfc681a68 and project 1367659f7d6a404393adca1c5d713c99. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:29:03.257868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2a31e5bd-55d3-4f21-89b0-8758d28cfb1b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.206941 Aug 23 08:29:03.258454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 490/998] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:29:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:29:05.457485 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1501418676", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbfb564c-9ab8-4c63-93b7-f241f865f1e6"}], "security_groups": [{"name": "tempest-securitygroup--2013042930"}], "key_name": "tempest-keypair-567189582", "user_data": "}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:29:05.460862 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:05.461525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:05.570359 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] validate_networks() for [('fbfb564c-9ab8-4c63-93b7-f241f865f1e6', None, None, None, None, None)] {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:29:06.034029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:29:06.034607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:29:06.035144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:29:06.035553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:29:06.035962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:29:06.045230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:06.045731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:06.046260 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:06.047001 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:06.047466 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:06.047887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:06.065775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for project 1367659f7d6a404393adca1c5d713c99. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:29:06.069830 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for user d780debf950447b983dc94edfc681a68 and project 1367659f7d6a404393adca1c5d713c99. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:29:06.081238 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:29:06.083562 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:29:06.230452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-75cb92f7-5616-4350-a912-62b22237cc9b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.782537 Aug 23 08:29:06.231173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 509/999] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:29:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:29:06.242200 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-06f1330d-428d-45a6-a07f-72e979140d30 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:06.243414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-06f1330d-428d-45a6-a07f-72e979140d30 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:06.315659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-06f1330d-428d-45a6-a07f-72e979140d30 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:06.332884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-06f1330d-428d-45a6-a07f-72e979140d30 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1241 microversion: 2.1 time: 0.094740 Aug 23 08:29:06.343365 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 491/1000] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:06 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:07.353894 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:07.354445 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:07.362147 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:07.362630 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:07.363087 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:07.363782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:07.364237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:07.364661 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:07.424674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:07.432279 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bc6534b9-1d6b-479d-b343-f2e022cd3eb8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1245 microversion: 2.1 time: 0.082514 Aug 23 08:29:07.432836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 510/1001] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:07 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:08.453816 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:08.454451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:08.460998 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:08.461499 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:08.461926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:08.462605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:08.463082 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:08.463543 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:08.555751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:08.564198 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3f7524f7-ef4b-4ff0-937f-04c8cba50627 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1301 microversion: 2.1 time: 0.115168 Aug 23 08:29:08.564763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 492/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:08 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1301 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:09.585660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:09.586387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:09.594394 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:09.594902 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:09.595441 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:09.596214 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:09.596744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:09.597239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:09.816405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:09.824546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ff3c84a2-a400-4c06-8aa2-b82b3dfe000f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1367 microversion: 2.1 time: 0.242391 Aug 23 08:29:09.825246 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 511/1003] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:09 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:10.237905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-4acf13e8-db30-43f5-9054-c0d5672f4f1a req-217698ba-58ee-47f1-9cb4-f15eec948c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c16436b-7038-404f-8a3d-e3c9525cbde4", "tag": "a3eaf65e-8023-4d0f-ae9d-6de366718ffe"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:29:10.247806 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-4acf13e8-db30-43f5-9054-c0d5672f4f1a req-217698ba-58ee-47f1-9cb4-f15eec948c1d service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:10.248392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-4acf13e8-db30-43f5-9054-c0d5672f4f1a req-217698ba-58ee-47f1-9cb4-f15eec948c1d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:10.248826 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-4acf13e8-db30-43f5-9054-c0d5672f4f1a req-217698ba-58ee-47f1-9cb4-f15eec948c1d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:10.261860 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-4acf13e8-db30-43f5-9054-c0d5672f4f1a req-217698ba-58ee-47f1-9cb4-f15eec948c1d service nova] Creating event network-changed:a3eaf65e-8023-4d0f-ae9d-6de366718ffe for instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 on hv-cinder-85407 Aug 23 08:29:10.267717 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-4acf13e8-db30-43f5-9054-c0d5672f4f1a req-217698ba-58ee-47f1-9cb4-f15eec948c1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034155 Aug 23 08:29:10.268356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 493/1004] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:29:10.844875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:10.845549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:10.852817 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:10.853467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:10.853940 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:10.854748 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:10.855293 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:10.855784 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:11.072147 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:11.080064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3467dfa5-84fc-40f3-8697-d533698140a0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1367 microversion: 2.1 time: 0.239303 Aug 23 08:29:11.080630 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 512/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:10 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:12.105074 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:12.105688 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:12.111929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:12.112426 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:12.112864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:12.113555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:12.114020 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:12.114450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:12.244850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:12.252713 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4d19976e-855d-4e3f-8831-23d0a741738b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1367 microversion: 2.1 time: 0.152552 Aug 23 08:29:12.253317 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 494/1006] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:12 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:13.279901 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:13.280546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:13.286614 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:13.287131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:13.287563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:13.288252 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:13.288703 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:13.289127 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:13.420733 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:13.428360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-134ed3df-f404-4166-bb3b-e58da07b0496 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1367 microversion: 2.1 time: 0.152908 Aug 23 08:29:13.428926 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 513/1007] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:13 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:14.448999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:14.449690 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:14.456148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:14.456770 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:14.457099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:14.457778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:14.458229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:14.458651 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:14.585367 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:14.593065 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2093d812-9952-4290-8d08-232e4ae91f39 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1367 microversion: 2.1 time: 0.148176 Aug 23 08:29:14.593620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 495/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:14 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:29:15.613922 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:15.614613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:15.621249 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:15.621838 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:15.622345 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:15.623575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:15.624033 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:15.624453 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:15.683286 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-cd219d1c-ebaf-41d5-af43-8bb2c88ae7b2 req-43a3311d-1c45-4666-b1a5-90e717e26c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c16436b-7038-404f-8a3d-e3c9525cbde4", "name": "network-vif-plugged", "status": "completed", "tag": "a3eaf65e-8023-4d0f-ae9d-6de366718ffe"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:29:15.694468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-cd219d1c-ebaf-41d5-af43-8bb2c88ae7b2 req-43a3311d-1c45-4666-b1a5-90e717e26c90 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:15.695213 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-cd219d1c-ebaf-41d5-af43-8bb2c88ae7b2 req-43a3311d-1c45-4666-b1a5-90e717e26c90 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:15.695685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-cd219d1c-ebaf-41d5-af43-8bb2c88ae7b2 req-43a3311d-1c45-4666-b1a5-90e717e26c90 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:15.708052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-cd219d1c-ebaf-41d5-af43-8bb2c88ae7b2 req-43a3311d-1c45-4666-b1a5-90e717e26c90 service nova] Creating event network-vif-plugged:a3eaf65e-8023-4d0f-ae9d-6de366718ffe for instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 on hv-cinder-85407 Aug 23 08:29:15.713080 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-cd219d1c-ebaf-41d5-af43-8bb2c88ae7b2 req-43a3311d-1c45-4666-b1a5-90e717e26c90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033606 Aug 23 08:29:15.713800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 496/1009] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:29:15.758567 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:15.769159 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4c0b3f4a-1486-4334-9594-fb3eee993fe9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1367 microversion: 2.1 time: 0.159056 Aug 23 08:29:15.770002 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 514/1010] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:15 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:16.786842 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=6 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:16.791425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:16.792116 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:16.798149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:16.798669 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:16.799142 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:16.799906 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:16.800407 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:16.800871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:16.927414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:16.935583 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e141ca47-a517-4d3e-9744-b50580a36ee1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1367 microversion: 2.1 time: 0.149461 Aug 23 08:29:16.936238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 497/1011] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:16 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:17.955592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:17.956212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:17.958068 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:17.958754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=6 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:17.964510 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:17.968475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:17.968475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:17.968475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:17.968475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:17.968839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:18.100353 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:18.108677 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-95b27fc2-81cb-40c9-91ef-8ca60f6b33e4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1556 microversion: 2.1 time: 0.156995 Aug 23 08:29:18.111024 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 515/1012] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:17 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:18.129935 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:18.130468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:18.136841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:18.137332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:18.137775 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:18.139059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:18.139552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:18.139983 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:18.217343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-850e80a5-0e1c-4b60-b2fc-a998f7ff89be tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090781 Aug 23 08:29:18.218150 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 498/1013] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Aug 23 08:29:18 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:29:19.154037 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-dc3ae8a5-ccb0-4832-a037-4802cfd7f13d req-76578c52-2f5c-409e-a226-14ad0590bc5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c16436b-7038-404f-8a3d-e3c9525cbde4", "tag": "a3eaf65e-8023-4d0f-ae9d-6de366718ffe"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:29:19.164090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dc3ae8a5-ccb0-4832-a037-4802cfd7f13d req-76578c52-2f5c-409e-a226-14ad0590bc5d service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:19.164576 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dc3ae8a5-ccb0-4832-a037-4802cfd7f13d req-76578c52-2f5c-409e-a226-14ad0590bc5d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:19.165013 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dc3ae8a5-ccb0-4832-a037-4802cfd7f13d req-76578c52-2f5c-409e-a226-14ad0590bc5d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:19.177163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-dc3ae8a5-ccb0-4832-a037-4802cfd7f13d req-76578c52-2f5c-409e-a226-14ad0590bc5d service nova] Creating event network-changed:a3eaf65e-8023-4d0f-ae9d-6de366718ffe for instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 on hv-cinder-85407 Aug 23 08:29:19.182137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-dc3ae8a5-ccb0-4832-a037-4802cfd7f13d req-76578c52-2f5c-409e-a226-14ad0590bc5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031881 Aug 23 08:29:19.182724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 516/1014] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:29:30.238713 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:30.239482 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=32 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:30.243507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:30.244023 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:30.249808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:30.250286 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:30.250715 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:30.252053 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:30.252501 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:30.256073 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:30.332578 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lazy-loading 'services' on Instance uuid cf370581-da67-41d0-9698-a68121dd8715 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:29:30.544914 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8d3b129c-9298-4ce9-8af7-a8acaa8082e2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/os-volume_attachments/27909906-2a55-4142-aa77-2eaccba26e06" status: 202 len: 0 microversion: 2.1 time: 0.307403 Aug 23 08:29:30.549185 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 499/1015] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:29:30 2022] DELETE /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/os-volume_attachments/27909906-2a55-4142-aa77-2eaccba26e06 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:29:32.714251 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:32.715140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=40 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:29:32.719347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-eec2eb73-3f42-4161-8725-507baf0f90b0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:29:32.725482 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eec2eb73-3f42-4161-8725-507baf0f90b0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:32.727436 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eec2eb73-3f42-4161-8725-507baf0f90b0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:32.727436 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-eec2eb73-3f42-4161-8725-507baf0f90b0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:32.748347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-eec2eb73-3f42-4161-8725-507baf0f90b0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Going to try to stop instance {{(pid=121382) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 08:29:32.897237 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-eec2eb73-3f42-4161-8725-507baf0f90b0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/action" status: 202 len: 0 microversion: 2.1 time: 0.184273 Aug 23 08:29:32.897829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 517/1016] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:29:32 2022] POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:29:32.907322 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:32.908193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:32.914487 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:32.914930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:32.915420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:32.916112 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:32.916575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:32.917008 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:33.051054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:33.058759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9a17d235-07f8-439b-a333-81b4b0810903 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.156241 Aug 23 08:29:33.059370 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 500/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:32 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:34.081632 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:34.082250 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:34.088373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:34.088856 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:34.089293 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:34.089979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:34.090431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:34.090852 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:34.222892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:34.230668 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-509cfb81-0a8a-4641-99e4-bce83f8c853f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.154256 Aug 23 08:29:34.231276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 518/1018] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:34 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:35.252503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:35.253119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:35.259613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:35.260104 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:35.260548 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:35.261243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:35.261704 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:35.262132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:35.387603 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:35.395712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-23e31ce7-3d64-4e1a-ae38-a7001986bd4f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.147171 Aug 23 08:29:35.396279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 501/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:35 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:36.417183 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:36.417791 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:36.424834 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:36.425315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:36.425748 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:36.426434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:36.426886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:36.427334 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:36.558434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:36.566245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-19f78fca-7302-4007-9d0c-06720f9a3de4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.152895 Aug 23 08:29:36.566803 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 519/1020] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:36 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:37.587595 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:37.588229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:37.594855 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:37.595441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:37.595887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:37.596587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:37.597052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:37.597540 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:37.724374 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:37.732183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-24c7b752-2e1e-4c98-881c-0fc0d8cee509 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.148489 Aug 23 08:29:37.732755 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 502/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:37 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:38.754027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:38.754647 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:38.761146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:38.761634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:38.762075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:38.762773 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:38.763260 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:38.763695 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:38.895529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:38.903327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5d2507c4-c2c6-4ce6-9735-2534a574f367 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.153698 Aug 23 08:29:38.903919 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 520/1022] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:38 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:39.924241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:39.924858 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:39.931314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:39.931802 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:39.932238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:39.932926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:39.933381 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:39.933805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:40.059246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:40.067159 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2682ffc6-7eb3-492b-bbb1-1801b7fe1e00 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.146782 Aug 23 08:29:40.067762 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 503/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:39 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:41.089032 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:41.089643 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:41.096064 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:41.096574 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:41.099387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:41.099387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:41.099387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:41.099387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:41.229389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:41.237548 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3a7b665e-ec09-4e4c-aa5b-568bd4fa5ea3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.152554 Aug 23 08:29:41.238112 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 521/1024] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:41 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:42.258256 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:42.258958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:42.265612 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:42.266102 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:42.266544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:42.267766 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:42.268226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:42.268654 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:42.393999 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:42.401729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b5e7f148-a937-4692-aeac-0810a487d1a7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.147941 Aug 23 08:29:42.402300 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 504/1025] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:42 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:43.422863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:43.424146 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:43.430177 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:43.430655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:43.431123 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:43.431808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:43.432262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:43.432687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:43.560327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:43.568059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-69ec2d5b-597e-491d-8e9c-910f71b6d0d7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1677 microversion: 2.1 time: 0.149225 Aug 23 08:29:43.568715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 522/1026] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:43 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:44.590098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:44.590709 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:44.597694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:44.598180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:44.598619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:44.599336 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:44.599796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:44.600219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:44.730922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:44.739258 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-772b2cc8-c357-4ef6-938a-12701a5f88c5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1654 microversion: 2.1 time: 0.152998 Aug 23 08:29:44.739824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 505/1027] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:44 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1654 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:44.759519 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5621c923-ee03-47a7-b42d-519c1be0ad1d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:29:44.765962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5621c923-ee03-47a7-b42d-519c1be0ad1d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:44.766439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5621c923-ee03-47a7-b42d-519c1be0ad1d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:44.766869 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5621c923-ee03-47a7-b42d-519c1be0ad1d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:44.788870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5621c923-ee03-47a7-b42d-519c1be0ad1d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Going to try to start instance {{(pid=121382) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 08:29:44.976216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5621c923-ee03-47a7-b42d-519c1be0ad1d tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/action" status: 202 len: 0 microversion: 2.1 time: 0.220498 Aug 23 08:29:44.977003 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 523/1028] 10.222.0.58 () {60 vars in 1278 bytes} [Tue Aug 23 08:29:44 2022] POST /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:29:44.985174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:44.985797 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:44.991790 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:44.996038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:44.996038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:44.996038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:44.996038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:44.996488 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:45.126116 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:45.134450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7ee6f71f-d196-43a9-b692-c81a828e9066 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1663 microversion: 2.1 time: 0.153275 Aug 23 08:29:45.135044 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 506/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:44 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:46.156358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:46.157361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:46.163826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:46.164312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:46.164753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:46.165447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:46.165902 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:46.166327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:46.302400 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:46.310182 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-adbd175b-c1f2-4ece-b93f-b15a92b8359e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1663 microversion: 2.1 time: 0.158182 Aug 23 08:29:46.310757 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 524/1030] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:46 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:29:47.332811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:29:47.333427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:29:47.340203 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:47.340698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:47.341137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:47.341832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:29:47.342292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:29:47.342720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:29:47.469260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:29:47.477672 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d6bd1483-e49e-4456-a758-6ae3ca5d523a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1667 microversion: 2.1 time: 0.149292 Aug 23 08:29:47.478264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 507/1031] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:29:47 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1667 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:25.272591 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:25.273125 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:25.275134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-69dc6465-0104-4902-b8ca-2639991e3f9f req-9cc0f592-8956-4d24-bf1e-6e824ed97753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50f4b20-cc8e-40bf-925f-823811815d70", "tag": "12c59a69-5657-4426-9266-ea6ab28bbd96"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:25.275552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=16 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:25.275967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:25.280296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=18 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:25.280969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:25.281157 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:25.281887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:25.282313 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:25.283219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:25.283675 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:25.289124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:25.289251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-69dc6465-0104-4902-b8ca-2639991e3f9f req-9cc0f592-8956-4d24-bf1e-6e824ed97753 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:25.289251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-69dc6465-0104-4902-b8ca-2639991e3f9f req-9cc0f592-8956-4d24-bf1e-6e824ed97753 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:25.289251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-69dc6465-0104-4902-b8ca-2639991e3f9f req-9cc0f592-8956-4d24-bf1e-6e824ed97753 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:25.308729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-69dc6465-0104-4902-b8ca-2639991e3f9f req-9cc0f592-8956-4d24-bf1e-6e824ed97753 service nova] Creating event network-changed:12c59a69-5657-4426-9266-ea6ab28bbd96 for instance a50f4b20-cc8e-40bf-925f-823811815d70 on hv-cinder-85407 Aug 23 08:30:25.315801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-69dc6465-0104-4902-b8ca-2639991e3f9f req-9cc0f592-8956-4d24-bf1e-6e824ed97753 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043846 Aug 23 08:30:25.320711 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 508/1032] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:30:25.322030 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:30:25.594692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6bbf8d70-7aa7-4905-97fa-92fb58b668e0 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 204 len: 0 microversion: 2.1 time: 0.326337 Aug 23 08:30:25.598739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 525/1033] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:30:25 2022] DELETE /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 08:30:25.605124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:25.605969 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:25.614024 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:25.614586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:25.615117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:25.615882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:25.616396 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:25.616875 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:25.760529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:25.768650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-132591a3-5d63-4090-a289-f179adf572d9 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.168351 Aug 23 08:30:25.769226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 509/1034] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:25 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:30:26.790596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:26.797962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:26.797962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:26.798349 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:26.798787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:26.799545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:26.799979 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:26.800401 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:27.004615 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:27.012458 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e6a9ebae-a310-453c-a06d-88ea7d8e635c tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1567 microversion: 2.1 time: 0.226360 Aug 23 08:30:27.013029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 526/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:26 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:28.034243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:28.034879 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:28.041027 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:28.041511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:28.041952 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:28.042698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:28.043194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:28.043624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:28.258152 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-f84e90f4-4528-470b-9712-82ccc3a20161 req-bda508ad-1f5f-42f5-bd8b-70005b319a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50f4b20-cc8e-40bf-925f-823811815d70", "name": "network-vif-deleted", "tag": "12c59a69-5657-4426-9266-ea6ab28bbd96"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:28.263671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:28.269486 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f84e90f4-4528-470b-9712-82ccc3a20161 req-bda508ad-1f5f-42f5-bd8b-70005b319a1c service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:28.269968 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f84e90f4-4528-470b-9712-82ccc3a20161 req-bda508ad-1f5f-42f5-bd8b-70005b319a1c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:28.270403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f84e90f4-4528-470b-9712-82ccc3a20161 req-bda508ad-1f5f-42f5-bd8b-70005b319a1c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:28.272768 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d22f481d-68aa-4454-8beb-07bd95843db5 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1449 microversion: 2.1 time: 0.242793 Aug 23 08:30:28.273340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 510/1036] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:28 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1449 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:28.281768 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-f84e90f4-4528-470b-9712-82ccc3a20161 req-bda508ad-1f5f-42f5-bd8b-70005b319a1c service nova] Creating event network-vif-deleted:12c59a69-5657-4426-9266-ea6ab28bbd96 for instance a50f4b20-cc8e-40bf-925f-823811815d70 on hv-cinder-85407 Aug 23 08:30:28.290831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-f84e90f4-4528-470b-9712-82ccc3a20161 req-bda508ad-1f5f-42f5-bd8b-70005b319a1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Aug 23 08:30:28.290831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 527/1037] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:30:29.293645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:29.294296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:29.301005 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:29.301639 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:29.302146 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:29.302850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:29.303325 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:29.303747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:29.334864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:29.335366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:29.335800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:29.336310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lazy-loading 'fault' on Instance uuid a50f4b20-cc8e-40bf-925f-823811815d70 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:30:29.378880 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef9753669de440489453104bbe61b449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80bce57227744ac9be2fda344a86e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:29.386496 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-191d7db2-eb9e-4fb9-a8fc-805efe4209e4 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 200 len: 1225 microversion: 2.1 time: 0.096766 Aug 23 08:30:29.387098 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 511/1038] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:29 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:30.409698 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:30.410491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] [instance: a50f4b20-cc8e-40bf-925f-823811815d70] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:30.416785 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:30.417273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:30.417705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:30.418417 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:30.418870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:30.419395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:30.433809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] HTTP exception thrown: Instance a50f4b20-cc8e-40bf-925f-823811815d70 could not be found. Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Request method failure captured: Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 HTTP/1.1 Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI7KWK_RXJlnTQH8InJS_x5SpWZTPNvGSurYBXNrKYUoxYJDOBr8BKQKXT9XsIiddXbxtaNdqlHbsWNXtR6D6T0tk5q42LhOfxcALLy8790PmQuo8lFoz9F7XCsTvCv2vm1EQj3184ksktctUgoWBZsNpbZQAR7VzZ6GEUyljjsFCG4 Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: f80bce57227744ac9be2fda344a86e39 Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-TestShelveInstance-1881624892 Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:30:30.435476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f80bce57227744ac9be2fda344a86e39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f80bce57227744ac9be2fda344a86e39", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f80bce57227744ac9be2fda344a86e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f80bce57227744ac9be2fda344a86e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-TestShelveInstance-1881624892 Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: f80bce57227744ac9be2fda344a86e39 Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-TestShelveInstance-1881624892 Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-TestShelveInstance-1881624892-project Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: ef9753669de440489453104bbe61b449 Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-TestShelveInstance-1881624892-project Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance a50f4b20-cc8e-40bf-925f-823811815d70 could not be found. Aug 23 08:30:30.437090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'a50f4b20-cc8e-40bf-925f-823811815d70'} Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a50f4b20-cc8e-40bf-925f-823811815d70 could not be found. Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:30:30.438044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a50f4b20-cc8e-40bf-925f-823811815d70 could not be found. Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a50f4b20-cc8e-40bf-925f-823811815d70 could not be found. Aug 23 08:30:30.439674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:30.441586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Returning 404 to user: Instance a50f4b20-cc8e-40bf-925f-823811815d70 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:30:30.441586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-51487123-800c-4092-aecc-44e783bc1c94 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70" status: 404 len: 111 microversion: 2.1 time: 0.032568 Aug 23 08:30:30.441586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 528/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:30 2022] GET /compute/v2.1/servers/a50f4b20-cc8e-40bf-925f-823811815d70 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:30:30.672989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-55b92fe0-af4a-4c1f-bf05-b0262a45b785 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] Calling method '.version_select at 0x7fa61be635e0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:30.823948 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-55b92fe0-af4a-4c1f-bf05-b0262a45b785 tempest-TestShelveInstance-1881624892 tempest-TestShelveInstance-1881624892-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1879047049" status: 202 len: 0 microversion: 2.1 time: 0.154895 Aug 23 08:30:30.824585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 512/1040] 10.222.0.58 () {58 vars in 1254 bytes} [Tue Aug 23 08:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1879047049 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:30:34.432044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:34.432580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:34.441366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:34.441877 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:34.442357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:34.443100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:34.443563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:34.444020 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:34.469801 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a5c852ce-d0c2-4728-8248-b80ac10edd78 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/ips" status: 200 len: 149 microversion: 2.1 time: 0.041631 Aug 23 08:30:34.470367 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 529/1041] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:30:34 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:30:37.479920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cd99bba-4b97-407c-b7ea-d9a1e7a7736f"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:37.483958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:37.492965 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:37.493472 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:37.493925 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:37.494634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:37.495577 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:37.496007 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:38.536774 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7e038075-d514-42c9-8b5a-623dc0e8d5a3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.062823 Aug 23 08:30:38.539735 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 513/1042] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:30:37 2022] POST /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments => generated 194 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:30:47.212483 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2a7628d4-e012-4906-81c5-54eae655951c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: .version_select at 0x7fa61a0bf9d0>, body: {"keypair": {"name": "tempest-keypair-1199999622", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzzzrk+YXqgvf05tC5EYBSNcEdHJaibKesAKd9NRjnFjMzDlv+Ckm2g/6uC8PJVMwsIV6yBOzXA/tJ0QSI/uy2yZOhWVCYQdUCU69mThiHL0vbUJrUHSDNWQJH69imvNQ=="}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:47.218206 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:47.218900 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:47.229891 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-2a7628d4-e012-4906-81c5-54eae655951c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for project 1367659f7d6a404393adca1c5d713c99. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:30:47.233629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-2a7628d4-e012-4906-81c5-54eae655951c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for user d780debf950447b983dc94edfc681a68 and project 1367659f7d6a404393adca1c5d713c99. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:30:47.333587 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2a7628d4-e012-4906-81c5-54eae655951c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125015 Aug 23 08:30:47.335187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 530/1043] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:30:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:30:50.237671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-541699869", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbfb564c-9ab8-4c63-93b7-f241f865f1e6"}], "security_groups": [{"name": "tempest-securitygroup--1497560991"}], "key_name": "tempest-keypair-1199999622", "user_data": "}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:50.254647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:50.255905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:30:50.474377 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] validate_networks() for [('fbfb564c-9ab8-4c63-93b7-f241f865f1e6', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:30:51.013655 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:51.018013 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:51.027577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:51.028433 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:51.028834 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:51.029569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:51.030230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:51.031211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:51.063958 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b50957c9-2564-4408-9193-4b0ac7749fb2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055093 Aug 23 08:30:51.064689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 531/1044] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:30:51 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 08:30:51.139606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:51.140127 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:51.146210 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:51.146913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:51.147584 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:51.148476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:51.148938 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:51.149362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:51.176080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:30:51.455148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:30:51.455667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:30:51.456046 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:30:51.456453 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:30:51.456865 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:30:51.461780 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-86537c89-8181-4488-a69a-050d7b10c689 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 204 len: 0 microversion: 2.1 time: 0.326310 Aug 23 08:30:51.462366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 532/1045] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:30:51 2022] DELETE /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 08:30:51.472315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:51.473023 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:51.473968 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:51.475747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:51.476434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:51.477370 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:51.478022 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:51.478611 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:51.479941 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:51.480627 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:51.481088 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:51.482221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:51.482724 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:51.483186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:51.509216 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for project 1367659f7d6a404393adca1c5d713c99. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:30:51.514052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for user d780debf950447b983dc94edfc681a68 and project 1367659f7d6a404393adca1c5d713c99. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:30:51.527325 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:30:51.529920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:30:51.712002 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:51.725595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-58764387-53b7-4f14-848f-595ecb01d2f7 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1673 microversion: 2.1 time: 0.256226 Aug 23 08:30:51.725595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 533/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:51 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1673 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:30:51.726042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-85b58789-7cac-4a9b-bfb7-8d0350c09f38 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.504936 Aug 23 08:30:51.727340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 514/1047] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:30:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:30:51.741610 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-df1713a4-7dbf-4285-939a-af3fd76c9829 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:51.742234 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-df1713a4-7dbf-4285-939a-af3fd76c9829 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:51.861891 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-df1713a4-7dbf-4285-939a-af3fd76c9829 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:51.871719 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-df1713a4-7dbf-4285-939a-af3fd76c9829 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1241 microversion: 2.1 time: 0.138108 Aug 23 08:30:51.872811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 534/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:51 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:52.745499 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:52.746219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:52.753813 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:52.754314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:52.754758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:52.756188 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:52.756840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:52.757328 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:52.892446 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:52.894247 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:52.902455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:52.903140 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:52.903865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:52.904846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:52.905686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:52.906411 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:52.906666 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:52.916598 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-92621520-501c-49ad-9db7-65195f115f50 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1673 microversion: 2.1 time: 0.174876 Aug 23 08:30:52.931346 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 515/1049] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:52 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1673 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:52.977439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:52.986425 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e5ef5625-4f56-414b-be2c-d142df9e0a54 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1245 microversion: 2.1 time: 0.098093 Aug 23 08:30:52.987011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 535/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:52 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:53.938442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:53.939807 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:53.949303 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:53.949303 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:53.949528 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:53.950502 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:53.950993 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:53.951431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:54.014710 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:54.017870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:54.027776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:54.029823 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:54.031586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:54.033235 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:54.033857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:54.034465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:54.269265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:54.273841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:54.294033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-aa087af9-10a7-4583-90f1-b7c5089e31f8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1605 microversion: 2.1 time: 0.359650 Aug 23 08:30:54.296826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3f3c9f79-5d0c-4888-bef7-5f940b96cf3c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1293 microversion: 2.1 time: 0.283157 Aug 23 08:30:54.297555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 536/1051] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:54 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1293 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:30:54.298454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 516/1052] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:53 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1605 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:54.642547 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-5ae1be51-29d8-46b9-b41a-eafa2d482869 req-3e2e75d2-c0bc-49ef-8f46-a4d8ddf50356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf370581-da67-41d0-9698-a68121dd8715", "name": "network-vif-deleted", "tag": "fbecc190-4008-4061-994b-b366d41f0d8d"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:54.678782 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-5ae1be51-29d8-46b9-b41a-eafa2d482869 req-3e2e75d2-c0bc-49ef-8f46-a4d8ddf50356 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:54.680322 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-5ae1be51-29d8-46b9-b41a-eafa2d482869 req-3e2e75d2-c0bc-49ef-8f46-a4d8ddf50356 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:54.681462 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-5ae1be51-29d8-46b9-b41a-eafa2d482869 req-3e2e75d2-c0bc-49ef-8f46-a4d8ddf50356 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:54.711482 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-5ae1be51-29d8-46b9-b41a-eafa2d482869 req-3e2e75d2-c0bc-49ef-8f46-a4d8ddf50356 service nova] Creating event network-vif-deleted:fbecc190-4008-4061-994b-b366d41f0d8d for instance cf370581-da67-41d0-9698-a68121dd8715 on hv-cinder-85407 Aug 23 08:30:54.728608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-5ae1be51-29d8-46b9-b41a-eafa2d482869 req-3e2e75d2-c0bc-49ef-8f46-a4d8ddf50356 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095520 Aug 23 08:30:54.729681 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 517/1053] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:30:54.898820 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-886ba584-3540-459f-b0db-21a285eb21e1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Action: 'create', calling method: .version_select at 0x7fa61a1039d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-235537889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzFVKRf6t2DoEz1Q8hCFBmBj6DbD5vdrwQZkTx/hW+VJBV8dehvg+IoOLGwL9pd4wQSsYsSBtpt+cWtkC8AcOSEEaygHMjingMvBMONuWG670Px1rGxirBUM6Y+osHdcQ=="}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:54.914990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-886ba584-3540-459f-b0db-21a285eb21e1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Getting quotas for project 7625c9efcc924680a5efef3fd71d0272. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:30:54.923814 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-886ba584-3540-459f-b0db-21a285eb21e1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Getting quotas for user db8b5a8edcc34d32a3e9fad54d33cbbc and project 7625c9efcc924680a5efef3fd71d0272. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:30:55.058863 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-886ba584-3540-459f-b0db-21a285eb21e1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.383911 Aug 23 08:30:55.061580 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 537/1054] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:30:54 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:30:55.316893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:55.318203 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:55.320173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:55.321168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:55.325909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:55.326689 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:55.327788 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:55.328728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:55.329367 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:55.329962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:55.332074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:55.332905 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:55.333495 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:55.334323 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:55.334968 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:55.335505 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:55.378711 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:55.380557 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:55.381275 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:55.383200 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lazy-loading 'fault' on Instance uuid cf370581-da67-41d0-9698-a68121dd8715 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:30:55.478251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:55.494318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f8d6ce2e-c412-400f-a77e-a9343e39ee27 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 200 len: 1328 microversion: 2.1 time: 0.177589 Aug 23 08:30:55.505862 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 518/1055] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:55 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 1328 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:55.583586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:55.600766 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d774a1cc-0326-477d-9c2a-5d3f5ee1c322 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.285695 Aug 23 08:30:55.601346 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 538/1056] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:55 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:56.513617 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:56.514233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:56.522483 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:56.522997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:56.523444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:56.524149 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:56.524604 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:56.525361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:56.544418 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] HTTP exception thrown: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Request method failure captured: Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 HTTP/1.1 Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI7-0TTRCN1hbqor-ZnVLHkaTpLvPaiQYY1RGDGOULFbvtWwI2xqfvBZOxDMUAgstg2jQcxUU3LWPnR3m7A9upY6TOCUuoF1V8nqkNcQ-O4Es6bfDPGkwmDIrsgpceAeRzlqI8GVbYiY-E_ptGfxn3-_E9DT32OjSPkYrcFL_IJ3ARI Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:30:56.546340 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c920ebfb7b046e08503e02473294eab", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 6960cb25d98c4b02a80900d97ab34a5a Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:30:56.548195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'cf370581-da67-41d0-9698-a68121dd8715'} Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:30:56.549311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:30:56.550930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:30:56.553516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Returning 404 to user: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:30:56.555804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-07de9533-c5a1-4b1b-bf7e-359066ffefc8 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 404 len: 111 microversion: 2.1 time: 0.046049 Aug 23 08:30:56.556389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 539/1057] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:56 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:30:56.565789 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-65e23937-ab0d-49ca-955a-62f0574ab814 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '.version_select at 0x7fa61a1033a0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:56.565986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-199bfe54-808a-4fb0-9281-f4d3b9f58966 req-d6049ac9-5805-4c17-bddb-85d98898dc1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0dc241-0001-4701-8766-de9c809ec2bf", "tag": "bf2a9b05-8962-4499-813a-c747377d5b65"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:56.579363 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-199bfe54-808a-4fb0-9281-f4d3b9f58966 req-d6049ac9-5805-4c17-bddb-85d98898dc1c service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:56.580171 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-199bfe54-808a-4fb0-9281-f4d3b9f58966 req-d6049ac9-5805-4c17-bddb-85d98898dc1c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:56.580832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-199bfe54-808a-4fb0-9281-f4d3b9f58966 req-d6049ac9-5805-4c17-bddb-85d98898dc1c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:56.592595 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-199bfe54-808a-4fb0-9281-f4d3b9f58966 req-d6049ac9-5805-4c17-bddb-85d98898dc1c service nova] Creating event network-changed:bf2a9b05-8962-4499-813a-c747377d5b65 for instance fb0dc241-0001-4701-8766-de9c809ec2bf on hv-cinder-85407 Aug 23 08:30:56.597619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-199bfe54-808a-4fb0-9281-f4d3b9f58966 req-d6049ac9-5805-4c17-bddb-85d98898dc1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128925 Aug 23 08:30:56.600192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 519/1058] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:30:56.622438 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:56.629019 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:56.630307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:56.630809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:56.631276 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:56.631993 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:56.632684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:56.633112 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:56.651840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-65e23937-ab0d-49ca-955a-62f0574ab814 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1780044312" status: 202 len: 0 microversion: 2.1 time: 0.089829 Aug 23 08:30:56.660875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 540/1059] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Aug 23 08:30:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1780044312 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:30:56.866674 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:56.881069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b6b71f10-0250-40cf-8d3b-bcf69387474a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.263011 Aug 23 08:30:56.886792 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 520/1060] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:56 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:30:57.666770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-30b1c13f-2d3d-4030-8a4e-d8120b34a6a9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'create', calling method: .version_select at 0x7fa61a0fa1f0>, body: {"keypair": {"name": "tempest-keypair-261751470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkHoky/e96npfwYopo+LqZyQsvNLAIvxVsuqnQXVhrW6GyLX+P4y/uNo5fSwGEoGYCxosu2jp/nKxWkGjOZLagNuuinYXuqy0V/JgRrV/C2FdRmQUpNS3xBkAWfS9O5LQ=="}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:30:57.683204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-30b1c13f-2d3d-4030-8a4e-d8120b34a6a9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Getting quotas for project 6c920ebfb7b046e08503e02473294eab. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:30:57.686988 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-30b1c13f-2d3d-4030-8a4e-d8120b34a6a9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Getting quotas for user 6960cb25d98c4b02a80900d97ab34a5a and project 6c920ebfb7b046e08503e02473294eab. Resources: {'key_pairs'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:30:57.805876 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-30b1c13f-2d3d-4030-8a4e-d8120b34a6a9 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143404 Aug 23 08:30:57.806860 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 541/1061] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:30:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:30:57.901637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:57.902257 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:57.909242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:57.909726 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:57.910187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:57.911092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:57.911563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:57.911992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:58.104553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:58.112751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f208c3c4-76e9-408c-9577-cc542e99a986 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.215003 Aug 23 08:30:58.113566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 521/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:57 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:30:59.134662 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:30:59.136525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:30:59.145424 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:59.146142 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:59.147037 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:59.148383 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:30:59.149060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:30:59.149487 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:30:59.299105 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:30:59.306997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-bb05c296-d601-4b4a-b969-7dcd5a5c288f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.176668 Aug 23 08:30:59.307566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 542/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:30:59 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:00.327894 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:00.328587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:00.335144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:00.335874 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:00.336468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:00.337292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:00.338459 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:00.338983 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:00.483194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:00.493469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a28d5111-02d8-4e42-9e73-fe4675a6f883 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.169550 Aug 23 08:31:00.494158 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 522/1064] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:00 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:00.913472 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1112111967", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8958c87f-457e-4a28-a97e-406303587bed"}], "security_groups": [{"name": "tempest-securitygroup--1279534731"}], "key_name": "tempest-keypair-261751470", "user_data": "}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:01.018991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] validate_networks() for [('8958c87f-457e-4a28-a97e-406303587bed', None, None, None, None, None)] {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:31:01.397242 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:31:01.397670 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:31:01.398151 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:31:01.398565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:31:01.399009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:31:01.408546 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:01.409024 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:01.409452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:01.410167 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:01.410673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:01.411241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:01.428356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Getting quotas for project 6c920ebfb7b046e08503e02473294eab. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:31:01.432208 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Getting quotas for user 6960cb25d98c4b02a80900d97ab34a5a and project 6c920ebfb7b046e08503e02473294eab. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:31:01.443624 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:31:01.446503 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:31:01.515011 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:01.516674 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:01.519403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:01.521168 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=6 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:01.524735 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:01.525231 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:01.525671 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:01.528578 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:01.528578 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:01.528578 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:01.572372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c17db964-0501-4250-907e-a9d77aa30c9e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663215 Aug 23 08:31:01.573042 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 543/1065] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:31:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 08:31:01.584634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a00f9ba9-1a60-4e33-961e-ce25e1e03875 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:01.585245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a00f9ba9-1a60-4e33-961e-ce25e1e03875 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:01.653230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a00f9ba9-1a60-4e33-961e-ce25e1e03875 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:01.662924 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a00f9ba9-1a60-4e33-961e-ce25e1e03875 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1237 microversion: 2.1 time: 0.082001 Aug 23 08:31:01.663629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 544/1066] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:01 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:01.698330 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:01.707723 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-527a65de-223e-40de-bf31-6f7c8958eddc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.196571 Aug 23 08:31:01.708490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 523/1067] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:01 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:31:02.683798 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:02.684408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:02.692634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:02.693244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:02.693693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:02.694506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:02.694996 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:02.695434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:02.729431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:02.730043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:02.737641 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:02.738360 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:02.738801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:02.739533 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:02.739993 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:02.740419 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:02.798008 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:02.807944 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-dd447f0a-faf9-48a2-ae2f-df780f49058b tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1241 microversion: 2.1 time: 0.128008 Aug 23 08:31:02.821452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 545/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:02 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1241 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:02.903959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:02.911237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5dad3674-f771-49f7-b2e8-28bbfa3bf5f5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.185767 Aug 23 08:31:02.911809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 524/1069] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:02 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:03.829004 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:03.829743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:03.836141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:03.836698 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:03.837191 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:03.838077 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:03.838528 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:03.838965 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:03.907697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:03.915446 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-692e438f-7e91-4a12-823d-86f5edb3862f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1297 microversion: 2.1 time: 0.090592 Aug 23 08:31:03.916023 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 546/1070] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:03 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:03.932037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:03.932658 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:03.939931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:03.940412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:03.942736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:03.942736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:03.942736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:03.942736 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:04.091743 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:04.100476 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-99ac6c9d-1f10-4374-9981-10e422b4b3ca tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.172288 Aug 23 08:31:04.101057 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 525/1071] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:03 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:04.268435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-3c10281d-2d88-4a71-ae73-370501613650 req-c704def4-5c0d-4478-98fb-5e6e1eff03bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0dc241-0001-4701-8766-de9c809ec2bf", "name": "network-vif-plugged", "status": "completed", "tag": "bf2a9b05-8962-4499-813a-c747377d5b65"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:04.278973 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3c10281d-2d88-4a71-ae73-370501613650 req-c704def4-5c0d-4478-98fb-5e6e1eff03bf service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:04.279454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3c10281d-2d88-4a71-ae73-370501613650 req-c704def4-5c0d-4478-98fb-5e6e1eff03bf service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:04.279887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3c10281d-2d88-4a71-ae73-370501613650 req-c704def4-5c0d-4478-98fb-5e6e1eff03bf service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:04.292124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-3c10281d-2d88-4a71-ae73-370501613650 req-c704def4-5c0d-4478-98fb-5e6e1eff03bf service nova] Creating event network-vif-plugged:bf2a9b05-8962-4499-813a-c747377d5b65 for instance fb0dc241-0001-4701-8766-de9c809ec2bf on hv-cinder-85407 Aug 23 08:31:04.297913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-3c10281d-2d88-4a71-ae73-370501613650 req-c704def4-5c0d-4478-98fb-5e6e1eff03bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032996 Aug 23 08:31:04.298707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 547/1072] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:31:04.936929 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:04.937578 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:04.944491 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:04.944974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:04.948340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:04.948340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:04.948340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:04.948340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:05.079015 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:05.087561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b913bccb-f764-42d6-86b8-f0d065a398cd tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.154405 Aug 23 08:31:05.088237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 526/1073] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:04 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:05.121320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:05.122006 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:05.128770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:05.129259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:05.129691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:05.130379 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:05.130835 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:05.131288 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:05.266283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:05.274012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5bd74805-b08d-4dd0-9c94-00bbed8ad3c8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.156872 Aug 23 08:31:05.274589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 548/1074] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:05 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:05.837962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-0f689c6f-773b-49e7-86c7-c4731eb7cba6 req-baa728df-0fa2-47e5-af75-dd3f1854ec3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d637234-8e3f-48ee-a5bd-18a1b7366031", "tag": "6370581f-4b3c-4f25-b8f0-333b7c2c219e"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:05.848242 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0f689c6f-773b-49e7-86c7-c4731eb7cba6 req-baa728df-0fa2-47e5-af75-dd3f1854ec3f service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:05.848727 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0f689c6f-773b-49e7-86c7-c4731eb7cba6 req-baa728df-0fa2-47e5-af75-dd3f1854ec3f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:05.849167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0f689c6f-773b-49e7-86c7-c4731eb7cba6 req-baa728df-0fa2-47e5-af75-dd3f1854ec3f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:05.861359 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-0f689c6f-773b-49e7-86c7-c4731eb7cba6 req-baa728df-0fa2-47e5-af75-dd3f1854ec3f service nova] Creating event network-changed:6370581f-4b3c-4f25-b8f0-333b7c2c219e for instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 on hv-cinder-85407 Aug 23 08:31:05.866563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-0f689c6f-773b-49e7-86c7-c4731eb7cba6 req-baa728df-0fa2-47e5-af75-dd3f1854ec3f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Aug 23 08:31:05.867215 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 527/1075] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:31:06.109504 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:06.110252 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:06.116765 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:06.117257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:06.117692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:06.118391 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:06.118846 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:06.119299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:06.256072 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:06.263737 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1e9f4423-4d5c-4720-a9c3-dfe38335a18a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.158259 Aug 23 08:31:06.264426 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 549/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:06 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:06.295539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:06.296241 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:06.302552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:06.303083 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:06.303530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:06.304236 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:06.304751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:06.305178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:06.439246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:06.447214 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b4a019d2-35aa-4939-9960-43bf2d44d113 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1367 microversion: 2.1 time: 0.156510 Aug 23 08:31:06.447771 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 528/1077] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:06 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:07.286190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:07.286790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:07.290294 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:07.293633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:07.294107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:07.294534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:07.295244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:07.295715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:07.296130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:07.432838 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:07.440716 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ce9e11f4-08b9-4991-abf1-7cdf1d61d9aa tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.159451 Aug 23 08:31:07.441334 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 550/1078] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:07 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:31:07.469002 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:07.470276 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:07.476930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:07.477419 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:07.477866 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:07.478558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:07.479055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:07.479490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:07.610222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:07.618343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-212a440a-ee54-40ce-81f5-f3ab610fe320 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1556 microversion: 2.1 time: 0.153309 Aug 23 08:31:07.618911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 529/1079] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:07 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:07.637990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:07.638477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:07.645392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:07.645882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:07.646312 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:07.647046 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:07.647499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:07.647913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:07.729672 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0233511e-ad18-4bb3-b1c0-47060d86cbbd tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095414 Aug 23 08:31:07.730255 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 551/1080] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Aug 23 08:31:07 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:31:08.462217 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:08.462805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:08.468920 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:08.469418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:08.469985 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:08.470655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:08.471416 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:08.471572 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:08.656885 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:08.664756 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f9f53eb3-a4c8-4b65-8674-4a06099a71f6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.206714 Aug 23 08:31:08.665361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 530/1081] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:08 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:08.797380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-f4674ce4-cfa5-43db-ad5d-97f10b47fa96 req-693d7c6a-817b-41d9-a58f-70e0ed9700fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb0dc241-0001-4701-8766-de9c809ec2bf", "tag": "bf2a9b05-8962-4499-813a-c747377d5b65"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:08.807323 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f4674ce4-cfa5-43db-ad5d-97f10b47fa96 req-693d7c6a-817b-41d9-a58f-70e0ed9700fd service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:08.807805 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f4674ce4-cfa5-43db-ad5d-97f10b47fa96 req-693d7c6a-817b-41d9-a58f-70e0ed9700fd service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:08.808240 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-f4674ce4-cfa5-43db-ad5d-97f10b47fa96 req-693d7c6a-817b-41d9-a58f-70e0ed9700fd service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:08.820331 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-f4674ce4-cfa5-43db-ad5d-97f10b47fa96 req-693d7c6a-817b-41d9-a58f-70e0ed9700fd service nova] Creating event network-changed:bf2a9b05-8962-4499-813a-c747377d5b65 for instance fb0dc241-0001-4701-8766-de9c809ec2bf on hv-cinder-85407 Aug 23 08:31:08.825692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-f4674ce4-cfa5-43db-ad5d-97f10b47fa96 req-693d7c6a-817b-41d9-a58f-70e0ed9700fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032860 Aug 23 08:31:08.826292 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 552/1082] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:31:09.685060 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:09.685673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:09.692850 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:09.693348 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:09.693778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:09.694510 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:09.695161 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:09.695996 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:09.844054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:09.852331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b4ed2108-0a6f-4109-9b53-d58a90aaa95e tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.171552 Aug 23 08:31:09.856827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 531/1083] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:09 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:10.879758 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:10.880509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:10.886740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:10.887264 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:10.887704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:10.888416 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:10.889265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:10.889265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:11.018565 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:11.022192 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:11.027743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5523d674-cab0-4a4d-850e-bf5cf8d85fde tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.152062 Aug 23 08:31:11.027743 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 553/1084] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:10 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:12.049555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:12.050090 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:12.056625 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:12.057121 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:12.057564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:12.058269 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:12.058729 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:12.059191 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:12.193430 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:12.201824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=100 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:12.207190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0fab3c1b-598f-40c2-a0bb-17e569d53b94 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.162398 Aug 23 08:31:12.211804 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 532/1085] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:12 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:13.227768 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:13.228376 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:13.230640 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:13.231318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=22 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:13.236977 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:13.238981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:13.238981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:13.238981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:13.239268 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:13.239470 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:13.366403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:13.374203 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a908099b-a999-40de-85c0-e0e1e2b525ce tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.150266 Aug 23 08:31:13.374720 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 554/1086] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:13 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:14.308482 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-b3cf8395-ac06-4760-92e7-bc6c430c5d69 req-422400ea-c361-4b54-8f2f-8bd6b5f9fdd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d637234-8e3f-48ee-a5bd-18a1b7366031", "name": "network-vif-plugged", "status": "completed", "tag": "6370581f-4b3c-4f25-b8f0-333b7c2c219e"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:14.319102 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-b3cf8395-ac06-4760-92e7-bc6c430c5d69 req-422400ea-c361-4b54-8f2f-8bd6b5f9fdd9 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:14.321049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-b3cf8395-ac06-4760-92e7-bc6c430c5d69 req-422400ea-c361-4b54-8f2f-8bd6b5f9fdd9 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:14.321049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-b3cf8395-ac06-4760-92e7-bc6c430c5d69 req-422400ea-c361-4b54-8f2f-8bd6b5f9fdd9 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:14.331052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-b3cf8395-ac06-4760-92e7-bc6c430c5d69 req-422400ea-c361-4b54-8f2f-8bd6b5f9fdd9 service nova] Creating event network-vif-plugged:6370581f-4b3c-4f25-b8f0-333b7c2c219e for instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 on hv-cinder-85407 Aug 23 08:31:14.335912 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-b3cf8395-ac06-4760-92e7-bc6c430c5d69 req-422400ea-c361-4b54-8f2f-8bd6b5f9fdd9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031565 Aug 23 08:31:14.336574 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 533/1087] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:31:14.395075 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:14.395909 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:14.403370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:14.403865 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:14.404506 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:14.405054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:14.405543 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:14.406284 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:14.543474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:14.551689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0e577bea-5ab2-4132-b790-4d271f9a27f5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.160603 Aug 23 08:31:14.552261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 555/1088] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:14 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:15.573101 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:15.573803 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:15.580706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:15.581198 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:15.581639 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:15.582334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:15.582797 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:15.583265 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:15.711710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:15.719504 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9a37974c-86f0-4820-941a-c669a2a851e3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.151378 Aug 23 08:31:15.720067 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 534/1089] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:15 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:16.739950 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:16.740658 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:16.747202 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:16.747692 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:16.748131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:16.748823 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:16.749281 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:16.749711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:16.882210 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:16.890333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ab186256-61f8-4c1d-aa8e-33b4c28d9ae2 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1363 microversion: 2.1 time: 0.154190 Aug 23 08:31:16.890908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 556/1090] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:16 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:17.910350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:17.911069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:17.917475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:17.917967 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:17.918411 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:17.919143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:17.919606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:17.920036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:18.298079 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:18.306323 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ee9d6f44-0684-4c40-8e65-acbc82085199 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1548 microversion: 2.1 time: 0.399880 Aug 23 08:31:18.306890 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 535/1091] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:17 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1548 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:18.326266 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:18.326825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:18.333121 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:18.333597 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:18.334024 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:18.334702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:18.335185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:18.335605 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:18.411036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-887b2714-7c08-4ba9-a163-c6099f19f22f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088170 Aug 23 08:31:18.411624 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 557/1092] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Aug 23 08:31:18 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:31:19.399428 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-365ddd84-6346-4353-84ba-909c96059398 req-56d14b4d-766f-4c12-ac2a-7697bd6f150b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d637234-8e3f-48ee-a5bd-18a1b7366031", "tag": "6370581f-4b3c-4f25-b8f0-333b7c2c219e"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:19.409511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-365ddd84-6346-4353-84ba-909c96059398 req-56d14b4d-766f-4c12-ac2a-7697bd6f150b service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:19.410000 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-365ddd84-6346-4353-84ba-909c96059398 req-56d14b4d-766f-4c12-ac2a-7697bd6f150b service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:19.410438 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-365ddd84-6346-4353-84ba-909c96059398 req-56d14b4d-766f-4c12-ac2a-7697bd6f150b service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:19.422322 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-365ddd84-6346-4353-84ba-909c96059398 req-56d14b4d-766f-4c12-ac2a-7697bd6f150b service nova] Creating event network-changed:6370581f-4b3c-4f25-b8f0-333b7c2c219e for instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 on hv-cinder-85407 Aug 23 08:31:19.427417 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-365ddd84-6346-4353-84ba-909c96059398 req-56d14b4d-766f-4c12-ac2a-7697bd6f150b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032594 Aug 23 08:31:19.428025 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 536/1093] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:31:20.355408 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-303786040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235537889", "security_groups": [{"name": "tempest-secgroup-smoke-296972092"}], "block_device_mapping_v2": [{"uuid": "5cec4f80-1538-4fe1-ab02-1422f1fd73e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "281f3789-20e8-4d95-9efb-a99bc038266f"}]}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:20.469936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] validate_networks() for [('281f3789-20e8-4d95-9efb-a99bc038266f', None, None, None, None, None)] {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:31:20.837875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:31:20.838302 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:31:20.838809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:31:20.839278 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:31:20.839697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:31:20.848668 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:20.849158 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:20.849593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:20.850319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:20.850775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:20.851303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:20.868154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Getting quotas for project 7625c9efcc924680a5efef3fd71d0272. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:31:20.872105 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Getting quotas for user db8b5a8edcc34d32a3e9fad54d33cbbc and project 7625c9efcc924680a5efef3fd71d0272. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:31:20.928069 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:31:20.930211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5cec4f80-1538-4fe1-ab02-1422f1fd73e9',volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:31:21.291361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9c93b81a-0c60-4762-82a1-3f8dca04e262 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.940295 Aug 23 08:31:21.292266 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 558/1094] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:31:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:31:21.305486 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-be39f77a-ba9f-4952-a802-8d49ef7dc856 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:21.306719 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-be39f77a-ba9f-4952-a802-8d49ef7dc856 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:21.310029 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:21.364640 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-be39f77a-ba9f-4952-a802-8d49ef7dc856 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:21.371893 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-be39f77a-ba9f-4952-a802-8d49ef7dc856 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1093 microversion: 2.1 time: 0.072369 Aug 23 08:31:21.372558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 537/1095] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:21 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:22.392461 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-eb239e0c-a0da-473c-ad1d-9c2f71c1e2ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:22.393700 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-eb239e0c-a0da-473c-ad1d-9c2f71c1e2ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:22.446590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-eb239e0c-a0da-473c-ad1d-9c2f71c1e2ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:22.453563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-eb239e0c-a0da-473c-ad1d-9c2f71c1e2ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1093 microversion: 2.1 time: 0.065466 Aug 23 08:31:22.454131 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 559/1096] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:22 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:23.473997 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:23.474784 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:23.482219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:23.482708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:23.483179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:23.483888 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:23.484349 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:23.484812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:23.548348 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:23.556002 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bee5564b-46e0-41ea-b8fc-d1902a2b9eeb tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1191 microversion: 2.1 time: 0.085853 Aug 23 08:31:23.556566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 538/1097] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:23 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:24.577786 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:24.578406 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:24.587887 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:24.588320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:24.588763 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:24.589529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:24.590084 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:24.590516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:24.730522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:24.739942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-95e4241f-73bc-40f1-8983-900f27732e17 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1276 microversion: 2.1 time: 0.166012 Aug 23 08:31:24.740624 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 560/1098] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:24 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:25.254868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-685db297-8461-4916-b3ce-d04c96662d07 req-7493b852-37b3-451d-a026-101f1434088b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cca62a1-fe32-41f1-90cd-a8d61e008f7f", "tag": "f7e3a5f6-3eb8-456e-8950-4ac1713098a8"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:25.264986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-685db297-8461-4916-b3ce-d04c96662d07 req-7493b852-37b3-451d-a026-101f1434088b service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:25.265909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-685db297-8461-4916-b3ce-d04c96662d07 req-7493b852-37b3-451d-a026-101f1434088b service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:25.266043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-685db297-8461-4916-b3ce-d04c96662d07 req-7493b852-37b3-451d-a026-101f1434088b service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:25.276992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-685db297-8461-4916-b3ce-d04c96662d07 req-7493b852-37b3-451d-a026-101f1434088b service nova] Creating event network-changed:f7e3a5f6-3eb8-456e-8950-4ac1713098a8 for instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f on hv-cinder-85407 Aug 23 08:31:25.281846 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-685db297-8461-4916-b3ce-d04c96662d07 req-7493b852-37b3-451d-a026-101f1434088b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032146 Aug 23 08:31:25.282662 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 539/1099] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:31:25.760429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:25.760982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:25.767742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:25.768229 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:25.768657 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:25.769361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:25.769810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:25.770227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:25.907483 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:25.916029 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-2b836330-d90f-414b-b286-17f206c10ff7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.159518 Aug 23 08:31:25.916604 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 561/1100] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:25 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:26.938223 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:26.938910 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:26.945163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:26.945903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:26.946336 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:26.947798 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:26.947798 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:26.947989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:27.077919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:27.086119 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1e16659d-5e48-4e4b-9037-43fd0141f08f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.152284 Aug 23 08:31:27.086698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 540/1101] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:26 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:28.106840 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:28.107416 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:28.113826 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:28.114301 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:28.114730 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:28.115431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:28.115880 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:28.116300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:28.243982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:28.251499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-04af2c6a-c9fb-4451-a76f-1df845124db2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.148598 Aug 23 08:31:28.252052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 562/1102] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:28 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:29.272877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:29.273498 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:29.279962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:29.280450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:29.280974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:29.281665 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:29.282129 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:29.282556 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:29.414567 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:29.422462 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-dec067d8-0339-4b28-8aa4-594e9f256018 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.154033 Aug 23 08:31:29.423061 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 541/1103] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:29 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:30.443120 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:30.443739 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:30.450416 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:30.450899 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:30.451457 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:30.452189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:30.452648 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:30.453076 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:30.580735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:30.588793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-83885e3b-e6ac-4bce-a0bf-550766c7b477 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.149583 Aug 23 08:31:30.589362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 563/1104] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:30 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:31.609695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:31.610296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:31.612739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:31.617523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:31.618009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:31.621263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:31.621263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:31.621263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:31.621263 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:31.751102 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:31.759389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e2157a71-c041-40d2-97f3-d6afb4da4a34 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.153537 Aug 23 08:31:31.759954 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 542/1105] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:31 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:32.781195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:32.781734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:32.783541 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:32.784656 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=8 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:32.790057 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:32.790537 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:32.790992 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:32.791674 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:32.792124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:32.792575 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:32.919886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:32.927796 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ac45310d-75da-4bf7-a9e9-9331ea9f7400 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.150489 Aug 23 08:31:32.928365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 564/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:32 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:33.949408 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:33.950110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:33.956868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:33.957352 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:33.957791 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:33.958485 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:33.959578 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:33.960086 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:34.091276 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:34.098904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-97ebb4eb-2146-4029-817e-9c95bc074ee2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.153635 Aug 23 08:31:34.099481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 543/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:33 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:35.119717 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:35.120337 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:35.126806 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:35.127333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:35.127794 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:35.128508 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:35.128963 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:35.129384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:35.259188 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:35.266836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c882379f-e5ea-44a5-a093-f0490131f68e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.151026 Aug 23 08:31:35.267433 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 565/1108] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:35 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:36.287296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:36.287885 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:36.295685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:36.296169 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:36.296602 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:36.297297 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:36.297748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:36.298174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:36.427143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:36.435015 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f5292754-76dc-4ff9-a9d8-43ee012faad7 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.151612 Aug 23 08:31:36.435592 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 544/1109] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:36 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:37.455987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:37.456573 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:37.458813 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:37.463491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:37.463962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:37.471102 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:37.471102 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:37.471102 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:37.471102 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:37.599259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:37.607373 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-29e044e3-4554-4eb3-9cfb-35503c5ec799 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.155255 Aug 23 08:31:37.607930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 566/1110] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:37 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:38.386830 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-d34d5e80-b056-4864-8f15-16311e97080b req-aa1cf208-951b-4d13-9e47-a1ce4d89dfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cca62a1-fe32-41f1-90cd-a8d61e008f7f", "name": "network-vif-plugged", "status": "completed", "tag": "f7e3a5f6-3eb8-456e-8950-4ac1713098a8"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:38.396917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d34d5e80-b056-4864-8f15-16311e97080b req-aa1cf208-951b-4d13-9e47-a1ce4d89dfad service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:38.397430 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d34d5e80-b056-4864-8f15-16311e97080b req-aa1cf208-951b-4d13-9e47-a1ce4d89dfad service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:38.397867 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d34d5e80-b056-4864-8f15-16311e97080b req-aa1cf208-951b-4d13-9e47-a1ce4d89dfad service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:38.409586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-d34d5e80-b056-4864-8f15-16311e97080b req-aa1cf208-951b-4d13-9e47-a1ce4d89dfad service nova] Creating event network-vif-plugged:f7e3a5f6-3eb8-456e-8950-4ac1713098a8 for instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f on hv-cinder-85407 Aug 23 08:31:38.414585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-d34d5e80-b056-4864-8f15-16311e97080b req-aa1cf208-951b-4d13-9e47-a1ce4d89dfad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032205 Aug 23 08:31:38.415234 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 545/1111] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:31:38.628978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:38.629638 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:38.636586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:38.637066 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:38.637525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:38.638212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:38.638662 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:38.639121 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:38.768684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:38.776550 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a0d38e8d-29c1-4709-9d46-646f72cbf7f1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.151587 Aug 23 08:31:38.781752 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 567/1112] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:38 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:39.802656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:39.803390 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:39.809587 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:39.810075 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:39.810515 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:39.811239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:39.811698 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:39.812125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:39.945849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:39.953903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-0bda310b-3ade-481e-970f-e64ef5343e01 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1264 microversion: 2.1 time: 0.155951 Aug 23 08:31:39.954473 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 546/1113] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:39 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:40.975583 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:40.976159 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:40.985917 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:40.986402 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:40.986830 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:40.987550 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:40.987998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:40.988413 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:41.122994 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:41.130663 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b679fa44-bb13-474e-b96f-c54143190845 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1451 microversion: 2.1 time: 0.159182 Aug 23 08:31:41.131265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 568/1114] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:40 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:31:41.153818 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:31:41.154420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:31:41.160781 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:41.163183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:41.163183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:41.163183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:41.163183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:41.163588 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:41.291413 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:31:41.299050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1b6186c4-c64b-4641-a04f-428216b1290d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1451 microversion: 2.1 time: 0.149081 Aug 23 08:31:41.299611 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 547/1115] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:31:41 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:31:43.381239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-d3a25601-74de-4404-8853-edcdf1ab9d68 req-f5c92c4e-c166-48e9-b0db-c44de593e21d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cca62a1-fe32-41f1-90cd-a8d61e008f7f", "tag": "f7e3a5f6-3eb8-456e-8950-4ac1713098a8"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:31:43.391117 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-d3a25601-74de-4404-8853-edcdf1ab9d68 req-f5c92c4e-c166-48e9-b0db-c44de593e21d service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:31:43.391603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-d3a25601-74de-4404-8853-edcdf1ab9d68 req-f5c92c4e-c166-48e9-b0db-c44de593e21d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:31:43.392032 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-d3a25601-74de-4404-8853-edcdf1ab9d68 req-f5c92c4e-c166-48e9-b0db-c44de593e21d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:31:43.395861 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=79 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:31:43.403444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-d3a25601-74de-4404-8853-edcdf1ab9d68 req-f5c92c4e-c166-48e9-b0db-c44de593e21d service nova] Creating event network-changed:f7e3a5f6-3eb8-456e-8950-4ac1713098a8 for instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f on hv-cinder-85407 Aug 23 08:31:43.408803 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-d3a25601-74de-4404-8853-edcdf1ab9d68 req-f5c92c4e-c166-48e9-b0db-c44de593e21d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031379 Aug 23 08:31:43.409389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 569/1116] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:23.998385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:23.998988 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:24.001194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=23 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:24.001864 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=68 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:24.006628 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:24.007160 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:24.007606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:24.008295 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:24.008754 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:24.009180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:24.033033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f49650e0-d95a-41ff-b591-8205f6ef4954 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf/ips" status: 200 len: 149 microversion: 2.1 time: 0.038438 Aug 23 08:32:24.033597 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 548/1117] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:32:23 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:24.043992 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=7 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:24.048327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cd99bba-4b97-407c-b7ea-d9a1e7a7736f"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:24.050704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:24.057205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:24.058614 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:24.058614 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:24.058889 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:24.059273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:24.059698 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:24.190441 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Invalid volume: volume 1cd99bba-4b97-407c-b7ea-d9a1e7a7736f is already attached to instances: 1c16436b-7038-404f-8a3d-e3c9525cbde4 Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: POST /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf/os-volume_attachments HTTP/1.1 Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 74 Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:32:24.192173 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {"volumeAttachment": {"volumeId": "1cd99bba-4b97-407c-b7ea-d9a1e7a7736f"}} Aug 23 08:32:24.193858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Invalid volume: volume 1cd99bba-4b97-407c-b7ea-d9a1e7a7736f is already attached to instances: 1c16436b-7038-404f-8a3d-e3c9525cbde4 Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'server_id': 'fb0dc241-0001-4701-8766-de9c809ec2bf', 'body': {'volumeAttachment': {'volumeId': '1cd99bba-4b97-407c-b7ea-d9a1e7a7736f'}}} Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1cd99bba-4b97-407c-b7ea-d9a1e7a7736f is already attached to instances: 1c16436b-7038-404f-8a3d-e3c9525cbde4 Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:32:24.195070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1cd99bba-4b97-407c-b7ea-d9a1e7a7736f is already attached to instances: 1c16436b-7038-404f-8a3d-e3c9525cbde4 Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:24.196966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:32:24.199352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:32:24.199352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:32:24.199352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:32:24.199352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1cd99bba-4b97-407c-b7ea-d9a1e7a7736f is already attached to instances: 1c16436b-7038-404f-8a3d-e3c9525cbde4 Aug 23 08:32:24.199352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:32:24.199352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 400 to user: Invalid volume: volume 1cd99bba-4b97-407c-b7ea-d9a1e7a7736f is already attached to instances: 1c16436b-7038-404f-8a3d-e3c9525cbde4 {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:32:24.199352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3ccb2356-2c6f-4625-94f7-37686712c78f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151799 Aug 23 08:32:24.199352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 570/1118] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:32:24 2022] POST /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:32:24.203604 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:24.204104 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:24.210444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:24.210921 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:24.211384 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:24.212073 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:24.212530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:24.212955 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:24.237422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:32:24.476726 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-77ed3d6d-1ebc-4731-b0dc-948d48b62352 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 204 len: 0 microversion: 2.1 time: 0.276762 Aug 23 08:32:24.477425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 549/1119] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:32:24 2022] DELETE /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:32:24.486319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:24.486933 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:24.493705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:24.494588 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:24.495303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:24.496010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:24.496469 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:24.496901 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:24.625118 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:24.632727 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1783fb5c-c6d8-4b59-8069-7c99e13c0216 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1681 microversion: 2.1 time: 0.150413 Aug 23 08:32:24.633296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 571/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:24 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:25.654265 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:25.654992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:25.661349 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:25.661830 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:25.662266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:25.662973 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:25.663431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:25.663854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:25.844463 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:25.852429 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-636ecc60-2d73-49df-b66a-63e6b0939a7f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1681 microversion: 2.1 time: 0.202356 Aug 23 08:32:25.852997 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 550/1121] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:25 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1681 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:26.873750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:26.874299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:26.880685 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:26.881160 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:26.881596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:26.882285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:26.882733 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:26.883187 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:27.017285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:27.025171 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3b09ead4-aff6-42bf-8619-9f06075df001 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1681 microversion: 2.1 time: 0.155288 Aug 23 08:32:27.025788 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 572/1122] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:26 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:27.429018 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-ac95a048-9c70-40ea-862a-a296229268cc req-54a499f0-eaa0-4b3d-bbb2-1f52e5f3e887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb0dc241-0001-4701-8766-de9c809ec2bf", "name": "network-vif-deleted", "tag": "bf2a9b05-8962-4499-813a-c747377d5b65"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:27.439026 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ac95a048-9c70-40ea-862a-a296229268cc req-54a499f0-eaa0-4b3d-bbb2-1f52e5f3e887 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:27.444712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ac95a048-9c70-40ea-862a-a296229268cc req-54a499f0-eaa0-4b3d-bbb2-1f52e5f3e887 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:27.444712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ac95a048-9c70-40ea-862a-a296229268cc req-54a499f0-eaa0-4b3d-bbb2-1f52e5f3e887 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:27.453480 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-ac95a048-9c70-40ea-862a-a296229268cc req-54a499f0-eaa0-4b3d-bbb2-1f52e5f3e887 service nova] Creating event network-vif-deleted:bf2a9b05-8962-4499-813a-c747377d5b65 for instance fb0dc241-0001-4701-8766-de9c809ec2bf on hv-cinder-85407 Aug 23 08:32:27.458435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-ac95a048-9c70-40ea-862a-a296229268cc req-54a499f0-eaa0-4b3d-bbb2-1f52e5f3e887 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033282 Aug 23 08:32:27.459425 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 551/1123] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:28.046608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:28.047200 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:28.053818 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:28.054309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:28.054747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:28.055484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:28.055944 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:28.056372 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:28.091160 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:28.091650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:28.092085 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:28.092536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lazy-loading 'fault' on Instance uuid fb0dc241-0001-4701-8766-de9c809ec2bf {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:32:28.133235 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:28.143971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8fbba3f1-c71c-4b79-9509-b14207f9aee8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 200 len: 1331 microversion: 2.1 time: 0.101261 Aug 23 08:32:28.157613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 573/1124] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:28 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:29.165032 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:29.165724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:29.172828 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:29.173310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:29.173778 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:29.174465 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:29.174919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:29.175371 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:29.189088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf HTTP/1.1 Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:32:29.190684 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:32:29.192279 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'fb0dc241-0001-4701-8766-de9c809ec2bf'} Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:32:29.193307 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:32:29.194848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:29.196667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:32:29.196667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a60aa66a-5bb2-473a-af11-8fa4e40d44d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 404 len: 111 microversion: 2.1 time: 0.031328 Aug 23 08:32:29.196667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 552/1125] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:29 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:32:29.201209 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-989f92d7-6bc5-47fe-a55d-8bc0725a7aa5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '.version_select at 0x7fa61a2779d0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:29.288558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-989f92d7-6bc5-47fe-a55d-8bc0725a7aa5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199999622" status: 202 len: 0 microversion: 2.1 time: 0.091253 Aug 23 08:32:29.289106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 574/1126] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Aug 23 08:32:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199999622 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:32:30.056089 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:30.056588 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:30.062582 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:30.063128 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:30.068149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:30.068149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:30.068149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:30.068149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:30.149849 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lazy-loading 'services' on Instance uuid 1c16436b-7038-404f-8a3d-e3c9525cbde4 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:32:30.349728 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8f68f148-d04c-47b5-beef-56445f240c01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments/1cd99bba-4b97-407c-b7ea-d9a1e7a7736f" status: 202 len: 0 microversion: 2.1 time: 0.297338 Aug 23 08:32:30.350452 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 553/1127] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:32:30 2022] DELETE /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments/1cd99bba-4b97-407c-b7ea-d9a1e7a7736f => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:32:30.359380 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:30.365967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:30.368254 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:30.368745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:30.369185 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:30.369882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:30.370375 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:30.370918 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:30.401515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9ee8e7d5-f1f9-4744-86f9-0d29d878a615 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046005 Aug 23 08:32:30.402084 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 575/1128] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:32:30 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:32:31.414370 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:31.417209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:31.423848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:31.424362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:31.424796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:31.425484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:31.425944 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:31.426368 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:31.455400 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b9b4b4e1-e500-46d5-b44b-1886db52ec79 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045324 Aug 23 08:32:31.455934 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 554/1129] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:32:31 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:32.467090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:32.469262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:32.475811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:32.476298 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:32.476738 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:32.477432 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:32.477889 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:32.478318 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:32.506465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-12c8c4a2-3cf4-44af-bd96-d69882f32960 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043398 Aug 23 08:32:32.506969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 576/1130] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:32:32 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:32:32.567497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:32.568012 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:32.574539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:32.575055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:32.575495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:32.576186 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:32.576639 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:32.577064 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:32.601229 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:32:32.858692 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f6444a4d-01ef-440f-8a0d-f91a038f6af4 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 204 len: 0 microversion: 2.1 time: 0.294717 Aug 23 08:32:32.859383 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 555/1131] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:32:32 2022] DELETE /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:32:32.867589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:32.868252 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:32.874553 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:32.875069 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:32.875507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:32.876191 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:32.876645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:32.877067 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:33.001895 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:33.009524 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-422da6c9-d9a6-4ffc-a420-799a2ca96fd3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1681 microversion: 2.1 time: 0.145884 Aug 23 08:32:33.010686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 577/1132] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:32 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:34.031895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:34.032634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:34.039153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:34.039633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:34.040065 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:34.040749 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:34.041896 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:34.042320 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:34.171544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:34.179412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1af5f2c8-74e6-441e-bd93-5aed3a2303f2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1681 microversion: 2.1 time: 0.151765 Aug 23 08:32:34.183060 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 556/1133] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:34 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:32:34.529920 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:34.530475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:34.536875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:34.537363 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:34.537797 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:34.538482 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:34.538935 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:34.539384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:34.562284 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fdbfe3fb-c408-4635-920e-ae64a16d8df6 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/ips" status: 200 len: 144 microversion: 2.1 time: 0.036362 Aug 23 08:32:34.562836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 578/1134] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:32:34 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:35.200996 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:35.201621 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:35.208173 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:35.208660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:35.209100 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:35.209805 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:35.210268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:35.210745 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:35.345070 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:35.352988 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4f8c2158-b019-4107-b907-66fead7590a7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1681 microversion: 2.1 time: 0.156081 Aug 23 08:32:35.353656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 557/1135] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:35 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:35.966343 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-6c189415-3f21-4a45-9a07-ca36b4c4f3df req-35de472f-7662-49ca-a72a-7b56ee421b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c16436b-7038-404f-8a3d-e3c9525cbde4", "name": "network-vif-deleted", "tag": "a3eaf65e-8023-4d0f-ae9d-6de366718ffe"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:35.977774 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-6c189415-3f21-4a45-9a07-ca36b4c4f3df req-35de472f-7662-49ca-a72a-7b56ee421b78 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:35.978303 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-6c189415-3f21-4a45-9a07-ca36b4c4f3df req-35de472f-7662-49ca-a72a-7b56ee421b78 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:35.988690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-6c189415-3f21-4a45-9a07-ca36b4c4f3df req-35de472f-7662-49ca-a72a-7b56ee421b78 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:35.990838 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-6c189415-3f21-4a45-9a07-ca36b4c4f3df req-35de472f-7662-49ca-a72a-7b56ee421b78 service nova] Creating event network-vif-deleted:a3eaf65e-8023-4d0f-ae9d-6de366718ffe for instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 on hv-cinder-85407 Aug 23 08:32:35.996054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-6c189415-3f21-4a45-9a07-ca36b4c4f3df req-35de472f-7662-49ca-a72a-7b56ee421b78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033926 Aug 23 08:32:35.996737 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 579/1136] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:36.373738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:36.374262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:36.380654 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:36.381149 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:36.381590 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:36.382296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:36.382761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:36.383214 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:36.416918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:36.417409 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:36.417861 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:36.418305 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lazy-loading 'fault' on Instance uuid 1c16436b-7038-404f-8a3d-e3c9525cbde4 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:32:36.459847 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:36.468392 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-596f8d47-6630-4dec-b156-7d2d038d8599 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 200 len: 1331 microversion: 2.1 time: 0.098597 Aug 23 08:32:36.469193 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 558/1137] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:36 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:37.218212 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb46c962-02ea-402f-9d45-7bf76b4bff46"}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:37.220598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:37.226579 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:37.227090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:37.227525 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:37.228199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:37.229142 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:37.229558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:37.489178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:37.489810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:37.496133 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:37.496679 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:37.497126 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:37.497817 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:37.498272 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:37.498697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:37.512278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 HTTP/1.1 Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:32:37.513840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:32:37.515481 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '1c16436b-7038-404f-8a3d-e3c9525cbde4'} Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:32:37.516343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:32:37.517841 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:32:37.525958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:32:37.525958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4508b476-b634-4a02-9788-affe6e1dc1c1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 404 len: 111 microversion: 2.1 time: 0.029896 Aug 23 08:32:37.525958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 559/1138] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:37 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 08:32:37.525958 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-fb3287a3-76c1-49cc-8d10-7b51d9a4276e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '.version_select at 0x7fa619fbb820>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:37.619174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-fb3287a3-76c1-49cc-8d10-7b51d9a4276e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-567189582" status: 202 len: 0 microversion: 2.1 time: 0.098629 Aug 23 08:32:37.619755 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 560/1139] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Aug 23 08:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-567189582 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:32:37.950475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3dd3d9db-f086-41ec-a164-4fba8b21ab06 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.736686 Aug 23 08:32:37.951273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 580/1140] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:32:37 2022] POST /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments => generated 194 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:38.390055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-06455e1c-c045-4d6b-a05d-f7f0c8df7fc5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: .version_select at 0x7fa61a103430>, body: {"keypair": {"name": "tempest-keypair-1029227293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJXbgShnWH5CGURBIA01HDUzUzu8dAA3jpIJfH8IHsnkIHiNBOciNSIJY5rx4t9NK7qeq9rynmG760KjFuXvn9PfWBK0Wf0Mr8WYLua3a01hni54DTXACpVbRGgjD5ieuQ=="}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:38.406598 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-06455e1c-c045-4d6b-a05d-f7f0c8df7fc5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for project 1367659f7d6a404393adca1c5d713c99. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:32:38.410442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-06455e1c-c045-4d6b-a05d-f7f0c8df7fc5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for user d780debf950447b983dc94edfc681a68 and project 1367659f7d6a404393adca1c5d713c99. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:32:38.522069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-06455e1c-c045-4d6b-a05d-f7f0c8df7fc5 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135833 Aug 23 08:32:38.522713 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 561/1141] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:32:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:40.755624 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1859698188", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbfb564c-9ab8-4c63-93b7-f241f865f1e6"}], "security_groups": [{"name": "tempest-securitygroup--634082555"}], "key_name": "tempest-keypair-1029227293", "user_data": "}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:40.861137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] validate_networks() for [('fbfb564c-9ab8-4c63-93b7-f241f865f1e6', None, None, None, None, None)] {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:32:41.224927 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:32:41.225349 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:32:41.225825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:32:41.226223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:32:41.226632 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:32:41.236382 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:41.236849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:41.237272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:41.237985 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:41.238431 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:41.238886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:41.255168 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for project 1367659f7d6a404393adca1c5d713c99. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:32:41.259121 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for user d780debf950447b983dc94edfc681a68 and project 1367659f7d6a404393adca1c5d713c99. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:32:41.269891 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:32:41.272260 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:32:41.392186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-db2d6ad8-07b9-4567-80f6-aceeb58117a1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.641311 Aug 23 08:32:41.392831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 581/1142] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:32:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:32:41.404981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-206b8e50-39dc-4f26-8d52-74fa016a390f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:41.405624 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-206b8e50-39dc-4f26-8d52-74fa016a390f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:41.463464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-206b8e50-39dc-4f26-8d52-74fa016a390f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:41.471979 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-206b8e50-39dc-4f26-8d52-74fa016a390f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1242 microversion: 2.1 time: 0.072185 Aug 23 08:32:41.474504 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 562/1143] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:41 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:42.493415 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:42.494662 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:42.501395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:42.501871 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:42.502305 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:42.503050 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:42.503509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:42.503936 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:42.565614 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:42.573512 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4a225f39-1f71-4d57-b891-8992b825b91a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1238 microversion: 2.1 time: 0.084005 Aug 23 08:32:42.574074 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 582/1144] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:42 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:43.594531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:43.595953 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:43.601856 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:43.602342 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:43.602780 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:43.604109 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:43.604733 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:43.605167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:43.672140 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:43.679911 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4dcd8a82-5628-4a32-ab23-530191f079c3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1300 microversion: 2.1 time: 0.089936 Aug 23 08:32:43.680554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 563/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:43 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:44.701943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:44.702563 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:44.709139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:44.709616 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:44.710044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:44.710722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:44.711206 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:44.711619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:44.843216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:44.850740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f88f3704-698e-43e0-8b8f-ee6f0bd5ee75 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.152646 Aug 23 08:32:44.851346 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 583/1146] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:44 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:45.281932 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-61e4a446-d8a4-41dc-ac0c-baa68414dc95 req-ce2f923a-2e91-4aaf-9eec-a38d28bcf9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bdf61b-1981-4500-a2f4-79cd870ade7e", "tag": "e2ccc139-f984-45b4-8fb3-dab60a181859"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:45.292771 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-61e4a446-d8a4-41dc-ac0c-baa68414dc95 req-ce2f923a-2e91-4aaf-9eec-a38d28bcf9d3 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:45.297290 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-61e4a446-d8a4-41dc-ac0c-baa68414dc95 req-ce2f923a-2e91-4aaf-9eec-a38d28bcf9d3 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:45.297290 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-61e4a446-d8a4-41dc-ac0c-baa68414dc95 req-ce2f923a-2e91-4aaf-9eec-a38d28bcf9d3 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:45.305405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-61e4a446-d8a4-41dc-ac0c-baa68414dc95 req-ce2f923a-2e91-4aaf-9eec-a38d28bcf9d3 service nova] Creating event network-changed:e2ccc139-f984-45b4-8fb3-dab60a181859 for instance a4bdf61b-1981-4500-a2f4-79cd870ade7e on hv-cinder-85407 Aug 23 08:32:45.311080 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-61e4a446-d8a4-41dc-ac0c-baa68414dc95 req-ce2f923a-2e91-4aaf-9eec-a38d28bcf9d3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032964 Aug 23 08:32:45.311857 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 564/1147] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:32:45.482322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:45.484668 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:45.490874 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:45.491468 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:45.491912 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:45.492619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:45.493077 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:45.493619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:45.524369 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-f8228025-066d-4e8e-8f45-28ccca447f96 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Aug 23 08:32:45.524942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 584/1148] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:32:45 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:45.536761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:45.537380 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:45.544331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:45.550010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:45.550010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:45.550010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:45.550010 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:45.550505 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:45.576357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-16b6f03b-87e5-4372-867e-b557d29a7913 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/fb46c962-02ea-402f-9d45-7bf76b4bff46" status: 200 len: 194 microversion: 2.1 time: 0.043947 Aug 23 08:32:45.583179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 565/1149] 10.222.0.58 () {58 vars in 1413 bytes} [Tue Aug 23 08:32:45 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/fb46c962-02ea-402f-9d45-7bf76b4bff46 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:45.870608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:45.871256 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:45.877969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:45.878449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:45.878916 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:45.882917 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:45.883410 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:45.883836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:46.019215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:46.027498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-beb67698-6002-4d7b-8bc1-6774c2284f0d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.160842 Aug 23 08:32:46.028077 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 585/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:45 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:47.047966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:47.048585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:47.055073 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:47.055557 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:47.055998 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:47.057328 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:47.057789 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:47.058219 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:47.062326 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:47.186328 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:47.193886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d979d58d-97c0-452e-961c-c1174099dced tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.149810 Aug 23 08:32:47.194457 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 566/1151] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:47 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:48.214104 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:48.214714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:48.221085 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:48.221558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:48.221983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:48.222669 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:48.223150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:48.223567 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:48.349935 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba7e5268-4ed5-4aca-aaba-962df75cac5b"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:48.352720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:48.360055 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:48.360542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:48.360986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:48.361689 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:48.362153 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:48.362623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:48.363101 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:48.372230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d4d75722-361d-4b77-8b7f-1f9a81a21cd0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.162050 Aug 23 08:32:48.372812 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 586/1152] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:48 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:49.392567 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:49.393220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:49.399763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-866654f7-e389-4eb2-b404-9396cf69ce2a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "POST /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.053908 Aug 23 08:32:49.406619 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:49.406754 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 567/1153] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:32:48 2022] POST /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments => generated 194 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:32:49.406845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:49.406845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:49.406845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:49.406845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:49.407231 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:49.421753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:49.538092 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:49.545775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c0afb8b1-e8ac-4082-a78b-9f57bd62f793 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.156980 Aug 23 08:32:49.546333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 587/1154] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:49 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:32:50.567302 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:50.568038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:50.575005 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:50.575494 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:50.575935 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:50.576633 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:50.577134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:50.577564 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:50.712720 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:50.721343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-cb73e23c-e217-4a3d-b5ee-1669f5e7404f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.158842 Aug 23 08:32:50.721926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 568/1155] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:50 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:32:51.742594 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:51.743227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:51.745424 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:51.746061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=6 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:51.751139 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:51.751620 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:51.752048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:51.752727 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:51.753221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:51.753634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:51.884019 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:51.891536 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9c08f2a5-1e54-42ee-b334-37d9772f482d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.153222 Aug 23 08:32:51.892093 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 588/1156] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:51 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:52.657364 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-93b9a5ce-8809-4708-b92b-25dc47694206 req-52127ad8-ee76-440a-aaf1-b680a008581d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bdf61b-1981-4500-a2f4-79cd870ade7e", "name": "network-vif-plugged", "status": "completed", "tag": "e2ccc139-f984-45b4-8fb3-dab60a181859"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:52.664375 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=6 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:52.668837 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-93b9a5ce-8809-4708-b92b-25dc47694206 req-52127ad8-ee76-440a-aaf1-b680a008581d service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:52.669315 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-93b9a5ce-8809-4708-b92b-25dc47694206 req-52127ad8-ee76-440a-aaf1-b680a008581d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:52.669748 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-93b9a5ce-8809-4708-b92b-25dc47694206 req-52127ad8-ee76-440a-aaf1-b680a008581d service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:52.680801 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-93b9a5ce-8809-4708-b92b-25dc47694206 req-52127ad8-ee76-440a-aaf1-b680a008581d service nova] Creating event network-vif-plugged:e2ccc139-f984-45b4-8fb3-dab60a181859 for instance a4bdf61b-1981-4500-a2f4-79cd870ade7e on hv-cinder-85407 Aug 23 08:32:52.689059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-93b9a5ce-8809-4708-b92b-25dc47694206 req-52127ad8-ee76-440a-aaf1-b680a008581d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032953 Aug 23 08:32:52.689059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 569/1157] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:52.911921 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:52.912562 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:52.918860 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:52.919901 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:52.920332 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:52.921012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:52.921463 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:52.921881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:53.054797 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:53.063379 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ab82b464-ed81-474d-bba5-9f99c3cd4a9f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.155353 Aug 23 08:32:53.063957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 589/1158] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:52 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:54.085658 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:54.086355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:54.093029 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:54.093507 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:54.093947 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:54.094634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:54.095122 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:54.095557 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:54.224384 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:54.232137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4b1e2a5a-a126-406d-bc38-7b869a9f6861 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1367 microversion: 2.1 time: 0.151558 Aug 23 08:32:54.232695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 570/1159] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:54 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:55.253196 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:55.253809 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:55.256083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:55.260782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:55.261266 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:55.261705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:55.262398 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:55.262862 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:55.263310 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:55.390732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:32:55.398396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fd3bab43-86bd-47bf-a75d-1461c237014e tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1557 microversion: 2.1 time: 0.149107 Aug 23 08:32:55.398976 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 590/1160] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:32:55 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:32:55.418734 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:55.419870 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:55.422227 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:32:55.426900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:55.427418 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:55.427860 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:55.428554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:55.429012 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:55.429466 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:55.509061 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bf86fe6d-9d77-4861-a9d8-38fcaa222f16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094139 Aug 23 08:32:55.509664 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 571/1161] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Aug 23 08:32:55 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:32:56.447454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-83f9c5d7-b5b7-4f9a-96ce-fe9c4b07c717 req-50b13bec-cfcf-4da1-801b-da835b57e61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bdf61b-1981-4500-a2f4-79cd870ade7e", "tag": "e2ccc139-f984-45b4-8fb3-dab60a181859"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:32:56.458052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-83f9c5d7-b5b7-4f9a-96ce-fe9c4b07c717 req-50b13bec-cfcf-4da1-801b-da835b57e61f service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:56.458534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-83f9c5d7-b5b7-4f9a-96ce-fe9c4b07c717 req-50b13bec-cfcf-4da1-801b-da835b57e61f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:56.458991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-83f9c5d7-b5b7-4f9a-96ce-fe9c4b07c717 req-50b13bec-cfcf-4da1-801b-da835b57e61f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:56.469966 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-83f9c5d7-b5b7-4f9a-96ce-fe9c4b07c717 req-50b13bec-cfcf-4da1-801b-da835b57e61f service nova] Creating event network-changed:e2ccc139-f984-45b4-8fb3-dab60a181859 for instance a4bdf61b-1981-4500-a2f4-79cd870ade7e on hv-cinder-85407 Aug 23 08:32:56.475093 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-83f9c5d7-b5b7-4f9a-96ce-fe9c4b07c717 req-50b13bec-cfcf-4da1-801b-da835b57e61f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031717 Aug 23 08:32:56.475740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 591/1162] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:57.982468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:57.984708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:57.991151 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:57.991631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:57.992066 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:57.992759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:57.993207 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:57.993628 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:58.023236 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8e9d65dd-610d-49c4-9b83-9a45687443cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046120 Aug 23 08:32:58.023784 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 572/1163] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:32:57 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:58.160486 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:58.161010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:58.167756 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:58.168245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:58.168684 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:58.169943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:58.170403 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:58.170833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:58.199378 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-52cdb531-2a78-4bc3-8607-e8ba0b45f2cf tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/fb46c962-02ea-402f-9d45-7bf76b4bff46" status: 200 len: 194 microversion: 2.1 time: 0.043319 Aug 23 08:32:58.199943 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 592/1164] 10.222.0.58 () {58 vars in 1413 bytes} [Tue Aug 23 08:32:58 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/fb46c962-02ea-402f-9d45-7bf76b4bff46 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:32:58.210139 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:32:58.210635 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:32:58.216511 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:58.216995 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:58.217434 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:58.218128 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:32:58.218586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:32:58.219047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:32:58.299312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lazy-loading 'services' on Instance uuid 8d637234-8e3f-48ee-a5bd-18a1b7366031 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:32:58.470080 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-130adecb-eaa0-441d-9381-9e0064404e65 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/fb46c962-02ea-402f-9d45-7bf76b4bff46" status: 202 len: 0 microversion: 2.1 time: 0.263639 Aug 23 08:32:58.470692 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 573/1165] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:32:58 2022] DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/fb46c962-02ea-402f-9d45-7bf76b4bff46 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:33:00.643136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:00.643628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:00.649921 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:00.650395 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:00.650829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:00.651555 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:00.652010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:00.652433 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:00.680434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-465cfe01-31f2-48d0-8c33-8dd9cd5b7bb3 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/ba7e5268-4ed5-4aca-aaba-962df75cac5b" status: 200 len: 194 microversion: 2.1 time: 0.041321 Aug 23 08:33:00.680993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 593/1166] 10.222.0.58 () {58 vars in 1413 bytes} [Tue Aug 23 08:33:00 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/ba7e5268-4ed5-4aca-aaba-962df75cac5b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:33:00.692764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:00.693350 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:00.699760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:00.700884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:00.701327 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:00.702023 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:00.702484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:00.702914 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:00.781962 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lazy-loading 'services' on Instance uuid 8d637234-8e3f-48ee-a5bd-18a1b7366031 {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:33:00.931930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-06b2a053-0efd-4ee4-b916-dd1b5ab2f5f0 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/ba7e5268-4ed5-4aca-aaba-962df75cac5b" status: 202 len: 0 microversion: 2.1 time: 0.243770 Aug 23 08:33:00.932554 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 574/1167] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:33:00 2022] DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments/ba7e5268-4ed5-4aca-aaba-962df75cac5b => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:33:02.107564 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:02.112392 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:02.116241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:02.116718 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:02.117150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:02.117827 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:02.118274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:02.118759 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:02.146752 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-534650b0-2ab3-4f43-85f8-da0cb5e4a057 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043821 Aug 23 08:33:02.147360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 594/1168] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:33:02 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:33:02.260194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:02.262519 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:02.268763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:02.269550 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:02.269708 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:02.270376 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:02.270823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:02.271284 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:02.300386 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e626b3be-62a2-40cd-ab95-42859ed16260 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044961 Aug 23 08:33:02.300932 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 575/1169] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:33:02 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:33:02.360964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:02.361459 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:02.367272 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:02.367747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:02.368175 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:02.368851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:02.369298 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:02.369714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:02.393930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:33:02.606835 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-d2dec76e-443c-40d3-ade5-7d59f54ce28a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 204 len: 0 microversion: 2.1 time: 0.249902 Aug 23 08:33:02.607470 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 595/1170] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:33:02 2022] DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:33:02.615650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:02.616808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:02.622289 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:02.622776 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:02.623243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:02.623941 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:02.624404 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:02.624831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:02.755231 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:33:02.763210 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8fb8c0a1-da38-4375-931c-c05902de5de5 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1672 microversion: 2.1 time: 0.151357 Aug 23 08:33:02.771591 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 576/1171] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:33:02 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1672 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:33:03.785178 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:03.785881 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:03.792364 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:03.792852 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:03.793287 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:03.793983 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:03.794447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:03.794873 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:03.944964 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:33:03.953473 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5a8ea290-0536-4682-8746-cfb1fe37495c tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1672 microversion: 2.1 time: 0.172805 Aug 23 08:33:03.954042 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 596/1172] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:33:03 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:33:04.973637 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:04.974238 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:04.980749 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:04.981260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:04.981691 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:04.982379 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:04.982829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:04.983273 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:05.114259 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:33:05.122417 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4bfe39ec-fd4b-4a6f-8a12-6efed4d24e01 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1672 microversion: 2.1 time: 0.152099 Aug 23 08:33:05.123003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 577/1173] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:33:04 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:33:06.087060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-3213b617-c2e8-48ba-8a3f-04ae3f512029 req-dc4194b2-2978-472f-a2a2-5a4437743b81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d637234-8e3f-48ee-a5bd-18a1b7366031", "name": "network-vif-deleted", "tag": "6370581f-4b3c-4f25-b8f0-333b7c2c219e"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:33:06.102590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3213b617-c2e8-48ba-8a3f-04ae3f512029 req-dc4194b2-2978-472f-a2a2-5a4437743b81 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:06.102590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3213b617-c2e8-48ba-8a3f-04ae3f512029 req-dc4194b2-2978-472f-a2a2-5a4437743b81 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:06.102590 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-3213b617-c2e8-48ba-8a3f-04ae3f512029 req-dc4194b2-2978-472f-a2a2-5a4437743b81 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:06.113400 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-3213b617-c2e8-48ba-8a3f-04ae3f512029 req-dc4194b2-2978-472f-a2a2-5a4437743b81 service nova] Creating event network-vif-deleted:6370581f-4b3c-4f25-b8f0-333b7c2c219e for instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 on hv-cinder-85407 Aug 23 08:33:06.118641 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-3213b617-c2e8-48ba-8a3f-04ae3f512029 req-dc4194b2-2978-472f-a2a2-5a4437743b81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 Aug 23 08:33:06.119391 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 597/1174] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:33:06.143760 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:06.144586 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:06.151288 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:06.152015 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:06.152561 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:06.154042 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:06.155344 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:06.155886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:06.226871 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6960cb25d98c4b02a80900d97ab34a5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c920ebfb7b046e08503e02473294eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:33:06.236377 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-79397f54-3f7e-4720-9cd5-bee38acd358f tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 200 len: 1604 microversion: 2.1 time: 0.096501 Aug 23 08:33:06.240939 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 578/1175] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:33:06 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 1604 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:33:07.258232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:07.258857 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:07.265423 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:07.265901 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:07.266333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:07.267044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:07.267499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:07.267919 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:07.280878 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] HTTP exception thrown: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Request method failure captured: Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 HTTP/1.1 Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI7-0TTRCN1hbqor-ZnVLHkaTpLvPaiQYY1RGDGOULFbvtWwI2xqfvBZOxDMUAgstg2jQcxUU3LWPnR3m7A9upY6TOCUuoF1V8nqkNcQ-O4Es6bfDPGkwmDIrsgpceAeRzlqI8GVbYiY-E_ptGfxn3-_E9DT32OjSPkYrcFL_IJ3ARI Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:33:07.282447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c920ebfb7b046e08503e02473294eab", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 6960cb25d98c4b02a80900d97ab34a5a Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:07.284154 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '8d637234-8e3f-48ee-a5bd-18a1b7366031'} Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:33:07.285130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:07.286808 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:07.288257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Returning 404 to user: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:33:07.288257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-dccf71e7-5046-40d2-a545-58c88a059455 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 404 len: 111 microversion: 2.1 time: 0.029978 Aug 23 08:33:07.288257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 598/1176] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:33:07 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:33:07.292751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ad04838d-5182-4b6a-9ded-9c9f9ba9d7bb tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '.version_select at 0x7fa61a09f280>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:07.367951 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ad04838d-5182-4b6a-9ded-9c9f9ba9d7bb tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-261751470" status: 202 len: 0 microversion: 2.1 time: 0.078982 Aug 23 08:33:07.368516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 579/1177] 10.222.0.58 () {58 vars in 1218 bytes} [Tue Aug 23 08:33:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-261751470 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:33:10.565832 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:10.566341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:10.573012 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:10.573493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:10.573930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:10.574613 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:10.575101 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:10.575526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:10.588836 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] HTTP exception thrown: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Request method failure captured: Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 HTTP/1.1 Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI7-0TTRCN1hbqor-ZnVLHkaTpLvPaiQYY1RGDGOULFbvtWwI2xqfvBZOxDMUAgstg2jQcxUU3LWPnR3m7A9upY6TOCUuoF1V8nqkNcQ-O4Es6bfDPGkwmDIrsgpceAeRzlqI8GVbYiY-E_ptGfxn3-_E9DT32OjSPkYrcFL_IJ3ARI Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:33:10.590347 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c920ebfb7b046e08503e02473294eab", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 6960cb25d98c4b02a80900d97ab34a5a Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.591957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '8d637234-8e3f-48ee-a5bd-18a1b7366031'} Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:33:10.593516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.595049 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.596749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Returning 404 to user: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:33:10.596749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6b6eb868-dc97-4cd6-a563-f8026e0d5515 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 404 len: 111 microversion: 2.1 time: 0.029838 Aug 23 08:33:10.596749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 599/1178] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:33:10 2022] DELETE /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:33:10.600455 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:10.601108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: 8d637234-8e3f-48ee-a5bd-18a1b7366031] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:10.608275 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:10.609414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:10.609857 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:10.610552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:10.611116 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:10.611549 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:10.624414 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] HTTP exception thrown: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Request method failure captured: Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 HTTP/1.1 Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI7-0TTRCN1hbqor-ZnVLHkaTpLvPaiQYY1RGDGOULFbvtWwI2xqfvBZOxDMUAgstg2jQcxUU3LWPnR3m7A9upY6TOCUuoF1V8nqkNcQ-O4Es6bfDPGkwmDIrsgpceAeRzlqI8GVbYiY-E_ptGfxn3-_E9DT32OjSPkYrcFL_IJ3ARI Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:33:10.626037 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c920ebfb7b046e08503e02473294eab", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: 6960cb25d98c4b02a80900d97ab34a5a Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.627670 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '8d637234-8e3f-48ee-a5bd-18a1b7366031'} Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:33:10.628529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. Aug 23 08:33:10.629815 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:10.630918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Returning 404 to user: Instance 8d637234-8e3f-48ee-a5bd-18a1b7366031 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:33:10.630918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e22369d1-9e79-400e-8aea-57665f46b2f4 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031" status: 404 len: 111 microversion: 2.1 time: 0.030795 Aug 23 08:33:10.630918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 580/1179] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:33:10 2022] GET /compute/v2.1/servers/8d637234-8e3f-48ee-a5bd-18a1b7366031 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 08:33:11.903967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:11.904472 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:11.910842 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:11.911355 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:11.911792 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:11.912476 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:11.912930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:11.913352 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:11.927089 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] HTTP exception thrown: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Request method failure captured: Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: DELETE /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 HTTP/1.1 Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI7-0TTRCN1hbqor-ZnVLHkaTpLvPaiQYY1RGDGOULFbvtWwI2xqfvBZOxDMUAgstg2jQcxUU3LWPnR3m7A9upY6TOCUuoF1V8nqkNcQ-O4Es6bfDPGkwmDIrsgpceAeRzlqI8GVbYiY-E_ptGfxn3-_E9DT32OjSPkYrcFL_IJ3ARI Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:33:11.928603 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c920ebfb7b046e08503e02473294eab", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: 6960cb25d98c4b02a80900d97ab34a5a Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.930259 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'cf370581-da67-41d0-9698-a68121dd8715'} Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:33:11.931244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.932783 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.934320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Returning 404 to user: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:33:11.934320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3e2afff3-5f4d-470a-9141-bca123e08353 tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "DELETE /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 404 len: 111 microversion: 2.1 time: 0.030037 Aug 23 08:33:11.934320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 600/1180] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:33:11 2022] DELETE /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:33:11.939559 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:33:11.940178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] [instance: cf370581-da67-41d0-9698-a68121dd8715] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:33:11.946877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:11.947501 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:11.947983 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:11.948681 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:33:11.949141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:33:11.949571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:33:11.962819 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] HTTP exception thrown: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Request method failure captured: Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 HTTP/1.1 Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI7-0TTRCN1hbqor-ZnVLHkaTpLvPaiQYY1RGDGOULFbvtWwI2xqfvBZOxDMUAgstg2jQcxUU3LWPnR3m7A9upY6TOCUuoF1V8nqkNcQ-O4Es6bfDPGkwmDIrsgpceAeRzlqI8GVbYiY-E_ptGfxn3-_E9DT32OjSPkYrcFL_IJ3ARI Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:33:11.964356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6c920ebfb7b046e08503e02473294eab", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6c920ebfb7b046e08503e02473294eab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 6c920ebfb7b046e08503e02473294eab Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeTestJSON-168975344 Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: 6960cb25d98c4b02a80900d97ab34a5a Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeTestJSON-168975344-project Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.965959 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'cf370581-da67-41d0-9698-a68121dd8715'} Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:33:11.966984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. Aug 23 08:33:11.968479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:33:11.970499 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] Returning 404 to user: Instance cf370581-da67-41d0-9698-a68121dd8715 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:33:11.970499 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ba754270-c7f5-4a56-8885-a0fe7b18718a tempest-AttachVolumeTestJSON-168975344 tempest-AttachVolumeTestJSON-168975344-project] 10.222.0.58 "GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715" status: 404 len: 111 microversion: 2.1 time: 0.030046 Aug 23 08:33:11.970499 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 581/1181] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:33:11 2022] GET /compute/v2.1/servers/cf370581-da67-41d0-9698-a68121dd8715 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:33:48.774526 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:33:48.775228 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Tue Aug 23 08:33:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:34:09.933196 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:09.933769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:09.936044 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:09.936686 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:09.941393 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:09.941878 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:09.942367 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:09.943100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:09.949010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:09.949010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:09.969583 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:34:10.252905 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a99304dd-6d10-40ba-a65c-bbdc58004b6c tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 204 len: 0 microversion: 2.1 time: 0.323735 Aug 23 08:34:10.253507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 601/1182] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:34:09 2022] DELETE /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:34:10.261569 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:10.262207 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:10.264629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:10.265284 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:10.270063 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:10.273984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:10.273984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:10.273984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:10.273984 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:10.274389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:10.401686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:10.409538 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-01c2c863-f81d-49a0-ab8d-40006fde756b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1576 microversion: 2.1 time: 0.151875 Aug 23 08:34:10.410099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 582/1183] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:10 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:11.430908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:11.431629 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:11.438652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:11.439194 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:11.439634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:11.440322 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:11.440781 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:11.441206 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:11.579181 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:11.586156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-28149f3b-3a5a-4d74-a5cb-db8bd20a9188 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1576 microversion: 2.1 time: 0.159082 Aug 23 08:34:11.599169 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 602/1184] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:11 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:11.719090 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:11.719590 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:11.725456 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:11.725938 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:11.726383 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:11.727106 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:11.727565 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:11.727989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:11.751615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-4dc43a13-9a05-44e4-9d94-3817eae733ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/ips" status: 200 len: 149 microversion: 2.1 time: 0.202711 Aug 23 08:34:11.752157 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 583/1185] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:34:11 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/ips => generated 149 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:34:12.608723 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:12.609341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:12.615705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:12.615895 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:12.616611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:12.617270 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:12.617894 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:12.618327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:12.756747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:12.765607 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-322576f1-0058-4aff-9a39-a139f8e3e4d0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1576 microversion: 2.1 time: 0.160901 Aug 23 08:34:12.766257 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 603/1186] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:12 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:13.292451 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-97175cb0-063f-41f8-bc9b-0138c3becd3c req-130e31de-a596-44a9-acec-f67e6a54b9fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cca62a1-fe32-41f1-90cd-a8d61e008f7f", "name": "network-vif-deleted", "tag": "f7e3a5f6-3eb8-456e-8950-4ac1713098a8"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:13.302607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-97175cb0-063f-41f8-bc9b-0138c3becd3c req-130e31de-a596-44a9-acec-f67e6a54b9fc service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:13.303197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-97175cb0-063f-41f8-bc9b-0138c3becd3c req-130e31de-a596-44a9-acec-f67e6a54b9fc service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:13.303685 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-97175cb0-063f-41f8-bc9b-0138c3becd3c req-130e31de-a596-44a9-acec-f67e6a54b9fc service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:13.315656 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-97175cb0-063f-41f8-bc9b-0138c3becd3c req-130e31de-a596-44a9-acec-f67e6a54b9fc service nova] Creating event network-vif-deleted:f7e3a5f6-3eb8-456e-8950-4ac1713098a8 for instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f on hv-cinder-85407 Aug 23 08:34:13.320764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-97175cb0-063f-41f8-bc9b-0138c3becd3c req-130e31de-a596-44a9-acec-f67e6a54b9fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032211 Aug 23 08:34:13.321840 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 584/1187] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:13.788626 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:13.789248 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:13.800925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:13.802011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:13.802011 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:13.802913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:13.803462 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:13.803956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:13.887398 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:13.895335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-32f9fa55-35a6-431b-bdd9-02f21514a9a4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 200 len: 1224 microversion: 2.1 time: 0.113611 Aug 23 08:34:13.895914 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 604/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:13 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:14.339577 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7304de09-9b53-405f-9d6f-696eb51c1fd7"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:14.342033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:14.353038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:14.353575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:14.354712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:14.359087 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:14.359087 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:14.359087 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:14.915542 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:14.916965 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:14.923545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:14.924054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:14.924493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:14.925252 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:14.925704 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:14.926129 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:14.941100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] HTTP exception thrown: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Request method failure captured: Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f HTTP/1.1 Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBJA2aBCV24D-60XlCBmt6dy-jN1n2f6Yutnw6xvXJyWaDYmRCt1Elv4BKIU1Dx_yAD73iLrCw0wcpFFaw4K1ZMvsb6FJlf15icNDW39I0-QKhRK7AvZQ8hlnmrZNhBRYCTZOyQeGIr6tCrN75Pields5CocUB9yEcJDr9xdLP9IBfw4 Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:34:14.942714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7625c9efcc924680a5efef3fd71d0272", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: db8b5a8edcc34d32a3e9fad54d33cbbc Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:34:14.944526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '8cca62a1-fe32-41f1-90cd-a8d61e008f7f'} Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:34:14.945533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:34:14.947219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:14.949090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Returning 404 to user: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:34:14.949090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-649261c0-a450-4939-a084-45a42f583e5a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 404 len: 111 microversion: 2.1 time: 0.032819 Aug 23 08:34:14.949090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 605/1189] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:14 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 08:34:15.040228 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2106693184", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235537889", "security_groups": [{"name": "tempest-secgroup-smoke-296972092"}], "block_device_mapping_v2": [{"uuid": "5cec4f80-1538-4fe1-ab02-1422f1fd73e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "281f3789-20e8-4d95-9efb-a99bc038266f"}]}} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:15.156803 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.network.neutron [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] validate_networks() for [('281f3789-20e8-4d95-9efb-a99bc038266f', None, None, None, None, None)] {{(pid=121382) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:34:15.188214 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-21c966bf-e36f-4547-89ef-c96971b7d8b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853652 Aug 23 08:34:15.188822 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 585/1190] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:34:14 2022] POST /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:15.632335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Flavor limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:34:15.632776 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Image limits 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:34:15.633284 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Flavor pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:34:15.633715 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Image pref 0:0:0 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:34:15.634106 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.virt.hardware [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121382) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:34:15.643294 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:15.643775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:15.644216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:15.645005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:15.645418 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:15.645841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:15.662412 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Getting quotas for project 7625c9efcc924680a5efef3fd71d0272. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:34:15.666273 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.quota [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Getting quotas for user db8b5a8edcc34d32a3e9fad54d33cbbc and project 7625c9efcc924680a5efef3fd71d0272. Resources: {'cores', 'ram', 'instances'} {{(pid=121382) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:34:15.723161 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Going to run 1 instances... {{(pid=121382) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:34:15.725387 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5cec4f80-1538-4fe1-ab02-1422f1fd73e9',volume_size=None,volume_type=None)] {{(pid=121382) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:34:16.106955 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-14ef6d38-da5f-43df-9015-48706523a186 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.070768 Aug 23 08:34:16.112631 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 606/1191] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:34:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:34:16.120020 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ea1f143f-f961-474b-9f1a-b0053fbe7b3a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:16.120800 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ea1f143f-f961-474b-9f1a-b0053fbe7b3a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:16.217403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ea1f143f-f961-474b-9f1a-b0053fbe7b3a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:16.225039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ea1f143f-f961-474b-9f1a-b0053fbe7b3a tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1094 microversion: 2.1 time: 0.110294 Aug 23 08:34:16.235944 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 586/1192] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:16 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1094 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:17.247291 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:17.247932 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:17.255041 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:17.255523 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:17.256972 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:17.257748 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:17.258226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:17.258667 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:17.322258 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:17.331283 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-35ea2de7-3c33-443f-9457-ee04ee0022aa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1144 microversion: 2.1 time: 0.088405 Aug 23 08:34:17.331858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 607/1193] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:17 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:18.351820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:18.352431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:18.360746 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:18.361227 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:18.361660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:18.362345 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:18.362794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:18.363246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:18.424876 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:18.433144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-50f0509c-e07c-41c2-bd35-5b1c5850f841 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1200 microversion: 2.1 time: 0.085211 Aug 23 08:34:18.453067 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 587/1194] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:18 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1200 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:19.454048 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:19.454673 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:19.461054 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:19.461542 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:19.461981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:19.462689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:19.463666 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:19.464093 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:19.529957 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:19.539698 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-49e1c624-3a18-4bdc-8f18-7944d8f996ef tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1210 microversion: 2.1 time: 0.089550 Aug 23 08:34:19.540281 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 608/1195] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:19 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:20.561244 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:20.562017 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:20.568252 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:20.568738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:20.569176 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:20.569868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:20.570360 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:20.570820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:20.611737 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-0f71d9e4-f6ab-4cd3-b9cf-51a278bbf1a5 req-dee34f42-5f9d-47f6-9224-9aa01c311348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5e6929-98d3-43e1-b7b4-092cb6f3c568", "tag": "6a04286a-4e1b-4373-82cc-0675f7e93c74"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:20.629962 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-0f71d9e4-f6ab-4cd3-b9cf-51a278bbf1a5 req-dee34f42-5f9d-47f6-9224-9aa01c311348 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:20.630446 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-0f71d9e4-f6ab-4cd3-b9cf-51a278bbf1a5 req-dee34f42-5f9d-47f6-9224-9aa01c311348 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:20.630882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-0f71d9e4-f6ab-4cd3-b9cf-51a278bbf1a5 req-dee34f42-5f9d-47f6-9224-9aa01c311348 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:20.642925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-0f71d9e4-f6ab-4cd3-b9cf-51a278bbf1a5 req-dee34f42-5f9d-47f6-9224-9aa01c311348 service nova] Creating event network-changed:6a04286a-4e1b-4373-82cc-0675f7e93c74 for instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 on hv-cinder-85407 Aug 23 08:34:20.647913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-0f71d9e4-f6ab-4cd3-b9cf-51a278bbf1a5 req-dee34f42-5f9d-47f6-9224-9aa01c311348 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040060 Aug 23 08:34:20.648502 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 609/1196] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:34:20.707064 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:20.715243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-21f703bb-3b9d-46b3-93d5-73037eb61b66 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1277 microversion: 2.1 time: 0.158447 Aug 23 08:34:20.715829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 588/1197] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:20 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:21.737557 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:21.738276 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:21.744447 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:21.751707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:21.751707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:21.751707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:21.751707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:21.752157 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:21.884466 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:21.892453 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-806d7b60-0ad0-4f17-b4c1-5dd9e1e4df23 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1277 microversion: 2.1 time: 0.159567 Aug 23 08:34:21.893348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 610/1198] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:21 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:22.775740 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7304de09-9b53-405f-9d6f-696eb51c1fd7"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:22.778484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:22.785062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:22.785551 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:22.785985 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:22.786780 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:22.787259 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:22.787680 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:22.866693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Invalid volume: volume 7304de09-9b53-405f-9d6f-696eb51c1fd7 is already attached to instances: a4bdf61b-1981-4500-a2f4-79cd870ade7e Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: POST /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments HTTP/1.1 Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 74 Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:34:22.868724 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {"volumeAttachment": {"volumeId": "7304de09-9b53-405f-9d6f-696eb51c1fd7"}} Aug 23 08:34:22.871222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Invalid volume: volume 7304de09-9b53-405f-9d6f-696eb51c1fd7 is already attached to instances: a4bdf61b-1981-4500-a2f4-79cd870ade7e Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'server_id': 'a4bdf61b-1981-4500-a2f4-79cd870ade7e', 'body': {'volumeAttachment': {'volumeId': '7304de09-9b53-405f-9d6f-696eb51c1fd7'}}} Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7304de09-9b53-405f-9d6f-696eb51c1fd7 is already attached to instances: a4bdf61b-1981-4500-a2f4-79cd870ade7e Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:34:22.872268 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7304de09-9b53-405f-9d6f-696eb51c1fd7 is already attached to instances: a4bdf61b-1981-4500-a2f4-79cd870ade7e Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:22.873909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:34:22.875534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:34:22.875534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:34:22.875534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:34:22.875534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7304de09-9b53-405f-9d6f-696eb51c1fd7 is already attached to instances: a4bdf61b-1981-4500-a2f4-79cd870ade7e Aug 23 08:34:22.875534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:34:22.875534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 400 to user: Invalid volume: volume 7304de09-9b53-405f-9d6f-696eb51c1fd7 is already attached to instances: a4bdf61b-1981-4500-a2f4-79cd870ade7e {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:34:22.875534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-2cc23fcd-e98b-425c-a67c-803861ff6b42 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098470 Aug 23 08:34:22.875534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 589/1199] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:34:22 2022] POST /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 08:34:22.913664 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:22.914779 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:22.924204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:22.924690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:22.925124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:22.925819 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:22.926274 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:22.926694 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:22.934259 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:22.934758 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:22.941575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:22.942068 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:22.942510 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:22.943230 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:22.943693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:22.944124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:23.025686 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.objects.instance [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lazy-loading 'services' on Instance uuid a4bdf61b-1981-4500-a2f4-79cd870ade7e {{(pid=121383) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:34:23.058919 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:23.067142 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-97753f5f-b648-47d9-9c35-fa8c4e59e264 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1277 microversion: 2.1 time: 0.157357 Aug 23 08:34:23.070299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 611/1200] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:22 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:23.228992 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-12a8a1ad-ec00-47d9-9907-8b1fe2c68a08 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments/7304de09-9b53-405f-9d6f-696eb51c1fd7" status: 202 len: 0 microversion: 2.1 time: 0.299138 Aug 23 08:34:23.230184 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 590/1201] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:34:22 2022] DELETE /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments/7304de09-9b53-405f-9d6f-696eb51c1fd7 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 08:34:23.238691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:23.240867 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:23.246718 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:23.247233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:23.247667 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:23.248355 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:23.248810 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:23.249230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:23.278501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6239275e-fe18-4596-805c-65b5f4086476 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Aug 23 08:34:23.283115 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 612/1202] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:34:23 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:24.089779 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:24.090389 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:24.096571 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:24.097048 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:24.097480 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:24.098164 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:24.098614 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:24.099062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:24.230828 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:24.239117 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-33e05c5c-9204-4bac-8e44-351f2947de86 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.154291 Aug 23 08:34:24.239694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 591/1203] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:24 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:24.291366 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:24.294059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:24.300690 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:24.301199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:24.301646 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:24.302341 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:24.302793 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:24.303241 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:24.334822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-7e35d761-a3c6-4058-ba5b-33b7080e9008 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047442 Aug 23 08:34:24.335405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 613/1204] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:34:24 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:25.261358 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:25.261974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:25.268551 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:25.269043 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:25.269484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:25.270205 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:25.270667 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:25.271144 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:25.347727 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:25.349886 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:25.356413 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:25.356897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:25.357333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:25.358034 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:25.358486 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:25.358916 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:25.389688 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-1194ad43-0d7c-4c4b-89bb-3956f84d8062 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045913 Aug 23 08:34:25.390260 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 614/1205] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:34:25 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:25.411385 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:25.419189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7299dc7f-4deb-44f2-a6d2-39e0630d710f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.162181 Aug 23 08:34:25.419761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 592/1206] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:25 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:26.401772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:26.404734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:26.406702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:26.407413 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=6 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:26.412637 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:26.415434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:26.415434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:26.415434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:26.415434 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:26.415850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:26.440372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:26.440986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:26.444183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:26.446666 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c6a11965-d408-47c1-a920-7d629a3493b3 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048848 Aug 23 08:34:26.447485 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 615/1207] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:34:26 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:34:26.449257 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:26.449751 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:26.450179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:26.451064 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:26.451515 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:26.451937 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:26.510733 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:26.511851 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:26.518815 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:26.519327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:26.519769 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:26.520477 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:26.520932 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:26.521356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:26.546742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:34:26.580990 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:26.587165 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:26.595835 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b8adec79-ebab-4926-b143-326ba52f76b3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.159308 Aug 23 08:34:26.601285 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 593/1208] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:26 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:26.885908 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-55fc48ff-4adf-4ef5-b0c8-a3efdadc3ec9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 204 len: 0 microversion: 2.1 time: 0.378786 Aug 23 08:34:26.887296 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 616/1209] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:34:26 2022] DELETE /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 08:34:26.895547 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:26.896171 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:26.902167 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:26.906114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:26.906114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:26.906114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:26.906114 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:26.906657 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:27.033814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:27.041595 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e43afaa9-85cf-4691-9f8f-5760241e592f tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1681 microversion: 2.1 time: 0.149972 Aug 23 08:34:27.042154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 594/1210] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:26 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:27.620371 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:27.621070 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:27.627682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:27.628166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:27.628611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:27.629362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:27.629822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:27.630245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:27.761611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:27.771735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4fa1bf83-af0c-4e5c-8081-a291ee730f1e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.154166 Aug 23 08:34:27.771735 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 617/1211] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:27 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:28.062521 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:28.063135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:28.069487 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:28.069968 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:28.070403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:28.071124 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:28.071582 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:28.072009 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:28.200148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:28.207812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-8a60d286-15e9-4398-8d87-254e8e11dc81 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1681 microversion: 2.1 time: 0.149277 Aug 23 08:34:28.208387 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 595/1212] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:28 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:28.791493 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:28.792265 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:28.799247 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:28.799736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:28.800174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:28.800872 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:28.801329 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:28.801753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:28.932389 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:28.940742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-345f700d-f2c5-47c6-92e8-a89b6574c4b9 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.153102 Aug 23 08:34:28.941327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 618/1213] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:28 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:29.229553 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:29.230811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:29.237205 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:29.237689 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:29.238123 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:29.238808 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:29.239298 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:29.243746 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:29.373592 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:29.381450 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-94083d64-55ab-4ed9-8876-6a9442775e9a tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1681 microversion: 2.1 time: 0.155886 Aug 23 08:34:29.382039 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 596/1214] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:29 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:29.596714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-81e42922-fbb9-4470-b663-c0cc020f1841 req-a0edb1bb-f073-48be-9439-723b83164b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bdf61b-1981-4500-a2f4-79cd870ade7e", "name": "network-vif-deleted", "tag": "e2ccc139-f984-45b4-8fb3-dab60a181859"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:29.608219 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-81e42922-fbb9-4470-b663-c0cc020f1841 req-a0edb1bb-f073-48be-9439-723b83164b3b service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:29.608429 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-81e42922-fbb9-4470-b663-c0cc020f1841 req-a0edb1bb-f073-48be-9439-723b83164b3b service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:29.613873 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-81e42922-fbb9-4470-b663-c0cc020f1841 req-a0edb1bb-f073-48be-9439-723b83164b3b service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:29.625498 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-81e42922-fbb9-4470-b663-c0cc020f1841 req-a0edb1bb-f073-48be-9439-723b83164b3b service nova] Creating event network-vif-deleted:e2ccc139-f984-45b4-8fb3-dab60a181859 for instance a4bdf61b-1981-4500-a2f4-79cd870ade7e on hv-cinder-85407 Aug 23 08:34:29.630654 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-81e42922-fbb9-4470-b663-c0cc020f1841 req-a0edb1bb-f073-48be-9439-723b83164b3b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037750 Aug 23 08:34:29.631269 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 619/1215] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:29.962773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:29.963357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:29.970096 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:29.970630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:29.971094 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:29.971795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:29.972251 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:29.972672 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:30.121909 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:30.129919 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-e3a21bd3-145d-49fe-86c7-cc3dc4f26f58 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.172037 Aug 23 08:34:30.131163 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 597/1216] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:29 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:30.402114 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:30.402934 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:30.409930 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:30.410474 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:30.410995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:30.411753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:30.412269 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:30.412750 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:30.444813 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:30.445291 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:30.445716 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:30.446156 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lazy-loading 'fault' on Instance uuid a4bdf61b-1981-4500-a2f4-79cd870ade7e {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:34:30.488358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:30.496227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-24cd1a0d-213a-45b4-b783-bbcf327faf16 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1332 microversion: 2.1 time: 0.098261 Aug 23 08:34:30.502999 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 620/1217] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:30 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:31.151493 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:31.152062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:31.159145 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:31.159634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:31.160073 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:31.160763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:31.161225 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:31.161654 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:31.179474 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:31.289463 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:31.297504 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-97e8ee8f-7f62-426a-920f-b423ec57fd9f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.149893 Aug 23 08:34:31.298084 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 598/1218] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:31 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:31.519405 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:31.520022 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:31.526680 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:31.527201 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:31.527644 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:31.528339 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:31.528797 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:31.529220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:31.562232 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:31.562754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:31.563223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:31.563678 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lazy-loading 'fault' on Instance uuid a4bdf61b-1981-4500-a2f4-79cd870ade7e {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:34:31.607811 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:31.615486 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-db598824-8a94-41c8-a389-d9371c23cd8c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 200 len: 1332 microversion: 2.1 time: 0.100080 Aug 23 08:34:31.616050 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 621/1219] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:31 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:32.318825 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:32.319471 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:32.326484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:32.327029 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:32.327468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:32.328191 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:32.328652 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:32.329081 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:32.457858 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:32.466140 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-aa7e8540-3edd-4d35-bc69-8950025f1b5b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.151543 Aug 23 08:34:32.466706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 599/1220] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:32 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:32.638100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:32.638640 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:32.644988 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:32.645471 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:32.645906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:32.646596 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:32.647087 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:32.647511 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:32.661490 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e HTTP/1.1 Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:34:32.663130 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:34:32.664833 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'a4bdf61b-1981-4500-a2f4-79cd870ade7e'} Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:34:32.666027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:34:32.667691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:34:32.669382 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:34:32.669382 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b10e0e54-8939-43ec-b562-c744e3bf23d8 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 404 len: 111 microversion: 2.1 time: 0.031153 Aug 23 08:34:32.669382 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 622/1221] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:32 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:34:32.673381 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f7d0fcd9-6f99-41d6-864b-96b3b079c7d0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '.version_select at 0x7fa61a0d0af0>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:32.785490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f7d0fcd9-6f99-41d6-864b-96b3b079c7d0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029227293" status: 202 len: 0 microversion: 2.1 time: 0.116001 Aug 23 08:34:32.786060 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 600/1222] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Aug 23 08:34:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029227293 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 08:34:33.487939 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:33.488469 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:33.494606 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:33.495124 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:33.495652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:33.497005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:33.497464 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:33.497897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:33.511308 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-79b7d3a3-41c1-47e4-99d1-cd60f5ec6ac1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: .version_select at 0x7fa61a1031f0>, body: {"keypair": {"name": "tempest-keypair-1046344612", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbkp96+qJWDLC4nUE1dW0k5XS3KR+pmY9YqBrYDiOSDNZVvm+06Gy9+S9RDJPcTrtsjYiob/fPTd0NzT/Mj+qlEFKxkMOHZEnnnJRzIbK+kwUSpdkOUXigSSLggOoaWDw=="}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:33.528018 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-79b7d3a3-41c1-47e4-99d1-cd60f5ec6ac1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for project 1367659f7d6a404393adca1c5d713c99. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:34:33.532092 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-79b7d3a3-41c1-47e4-99d1-cd60f5ec6ac1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for user d780debf950447b983dc94edfc681a68 and project 1367659f7d6a404393adca1c5d713c99. Resources: {'key_pairs'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:34:33.626141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-79b7d3a3-41c1-47e4-99d1-cd60f5ec6ac1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118686 Aug 23 08:34:33.627105 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 601/1223] 10.222.0.58 () {60 vars in 1159 bytes} [Tue Aug 23 08:34:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:34:33.637164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:33.645627 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6b017298-861d-4ec2-a748-58358a2aafee tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.161626 Aug 23 08:34:33.647262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 623/1224] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:33 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:34.668612 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:34.671069 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:34.675727 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:34.676222 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:34.676651 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:34.677354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:34.677854 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:34.678278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:34.815292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:34.823650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-07fe321b-6f50-409d-a4f4-d2f745013dad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.159209 Aug 23 08:34:34.824245 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 602/1225] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:34 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:35.282499 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-70201205-5ba9-4c29-821a-f627ec0495d3 req-acad54bc-7d07-4097-97f4-e52b60be3865 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5e6929-98d3-43e1-b7b4-092cb6f3c568", "name": "network-vif-plugged", "status": "completed", "tag": "6a04286a-4e1b-4373-82cc-0675f7e93c74"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:35.292368 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-70201205-5ba9-4c29-821a-f627ec0495d3 req-acad54bc-7d07-4097-97f4-e52b60be3865 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:35.292848 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-70201205-5ba9-4c29-821a-f627ec0495d3 req-acad54bc-7d07-4097-97f4-e52b60be3865 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:35.293280 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-70201205-5ba9-4c29-821a-f627ec0495d3 req-acad54bc-7d07-4097-97f4-e52b60be3865 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:35.304703 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-70201205-5ba9-4c29-821a-f627ec0495d3 req-acad54bc-7d07-4097-97f4-e52b60be3865 service nova] Creating event network-vif-plugged:6a04286a-4e1b-4373-82cc-0675f7e93c74 for instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 on hv-cinder-85407 Aug 23 08:34:35.310552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-70201205-5ba9-4c29-821a-f627ec0495d3 req-acad54bc-7d07-4097-97f4-e52b60be3865 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259430 Aug 23 08:34:35.313712 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 624/1226] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:34:35.791905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1499889710", "imageRef": "acf553e4-d094-4700-82b6-e87b58279069", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fbfb564c-9ab8-4c63-93b7-f241f865f1e6"}], "security_groups": [{"name": "tempest-securitygroup--1861739213"}], "key_name": "tempest-keypair-1046344612", "user_data": "}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:35.845552 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:35.848452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:35.852507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:35.852991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:35.853422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:35.854110 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:35.854561 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:35.855063 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:35.906294 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] validate_networks() for [('fbfb564c-9ab8-4c63-93b7-f241f865f1e6', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:34:36.067319 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:36.078702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-05f29674-ec37-494f-b041-abc5a9560bdc tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.234779 Aug 23 08:34:36.078702 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 625/1227] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:35 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:34:36.339296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:34:36.339718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:34:36.340187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:34:36.340613 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:34:36.341019 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:34:36.350664 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:36.351183 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:36.351616 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:36.352343 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:36.352802 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:36.353226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:36.369422 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for project 1367659f7d6a404393adca1c5d713c99. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:34:36.373706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Getting quotas for user d780debf950447b983dc94edfc681a68 and project 1367659f7d6a404393adca1c5d713c99. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:34:36.384501 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:34:36.386769 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='acf553e4-d094-4700-82b6-e87b58279069',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:34:36.524747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-20eb79de-6211-4b79-9223-8cf6ea5c0c11 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.737407 Aug 23 08:34:36.525544 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 603/1228] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:34:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 08:34:36.536385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-a08e2ff5-8124-4f3c-bcc6-e4a67f98a781 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:36.536998 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-a08e2ff5-8124-4f3c-bcc6-e4a67f98a781 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:36.589956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-a08e2ff5-8124-4f3c-bcc6-e4a67f98a781 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:36.596883 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-a08e2ff5-8124-4f3c-bcc6-e4a67f98a781 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1242 microversion: 2.1 time: 0.064412 Aug 23 08:34:36.597439 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 626/1229] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:36 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:37.097488 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:37.098051 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:37.104003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:37.104479 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:37.104907 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:37.105589 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:37.106036 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:37.106454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:37.235648 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:37.243513 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-10fbcc6f-d1f3-4306-957e-9fa00a6c419b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1265 microversion: 2.1 time: 0.151133 Aug 23 08:34:37.244088 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 604/1230] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:37 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:37.617521 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:37.618135 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:37.625159 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:37.625645 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:37.626083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:37.626819 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:37.627300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:37.627727 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:37.692005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:37.700181 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-0765d4cb-2fa9-4fb8-8793-c21a84fc3fed tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1246 microversion: 2.1 time: 0.086502 Aug 23 08:34:37.700864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 627/1231] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:37 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:38.265989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:38.266661 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:38.273135 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:38.273741 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:38.274215 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:38.274915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:38.275402 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:38.275834 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:38.411605 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:38.419403 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-cd01ea9e-97f2-4d39-89b6-156595a184f6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1451 microversion: 2.1 time: 0.158255 Aug 23 08:34:38.419970 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 605/1232] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:38 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:38.440885 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:38.441586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:38.447628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:38.448107 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:38.448812 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:38.449491 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:38.450009 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:38.450435 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:38.581611 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:38.589660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-10fbf73b-747c-4e2e-adfd-0bcfe6cd97c4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1451 microversion: 2.1 time: 0.153302 Aug 23 08:34:38.590239 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 628/1233] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:38 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:38.721143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:38.721764 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:38.727683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:38.728174 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:38.728615 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:38.729314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:38.729773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:38.730202 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:38.818475 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:38.831509 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-ac61795a-6fba-43b6-9eec-8c55ff0d8765 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1302 microversion: 2.1 time: 0.114776 Aug 23 08:34:38.832273 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 606/1234] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:38 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:39.852940 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:39.853767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:39.861849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:39.862992 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:39.863806 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:39.864687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:39.865320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:39.865913 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:40.055868 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:40.064321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c79b63e4-b705-4349-8e4b-1a207980f240 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1368 microversion: 2.1 time: 0.215783 Aug 23 08:34:40.065040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 629/1235] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:39 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:40.551468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-27785d84-8972-4eb9-9159-57754cf18bba req-d5ff15dd-44bc-4720-8e98-2615031da77a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d416e99-beb1-43a7-b3a2-8b455c2c8c44", "tag": "c8b6cdbf-e105-4f6c-bc6c-f519e171345c"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:40.558171 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:40.564631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-27785d84-8972-4eb9-9159-57754cf18bba req-d5ff15dd-44bc-4720-8e98-2615031da77a service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:40.565336 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-27785d84-8972-4eb9-9159-57754cf18bba req-d5ff15dd-44bc-4720-8e98-2615031da77a service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:40.565826 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-27785d84-8972-4eb9-9159-57754cf18bba req-d5ff15dd-44bc-4720-8e98-2615031da77a service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:40.578468 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-27785d84-8972-4eb9-9159-57754cf18bba req-d5ff15dd-44bc-4720-8e98-2615031da77a service nova] Creating event network-changed:c8b6cdbf-e105-4f6c-bc6c-f519e171345c for instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 on hv-cinder-85407 Aug 23 08:34:40.583669 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-27785d84-8972-4eb9-9159-57754cf18bba req-d5ff15dd-44bc-4720-8e98-2615031da77a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036338 Aug 23 08:34:40.584493 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 607/1236] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:40.941889 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-46de092c-f181-46c1-9386-98d4319275a3 req-a1ffbc7b-6613-4602-88e0-9c66b49ae8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5e6929-98d3-43e1-b7b4-092cb6f3c568", "tag": "6a04286a-4e1b-4373-82cc-0675f7e93c74"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:40.947744 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:40.953370 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-46de092c-f181-46c1-9386-98d4319275a3 req-a1ffbc7b-6613-4602-88e0-9c66b49ae8e5 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:40.953850 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-46de092c-f181-46c1-9386-98d4319275a3 req-a1ffbc7b-6613-4602-88e0-9c66b49ae8e5 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:40.954282 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-46de092c-f181-46c1-9386-98d4319275a3 req-a1ffbc7b-6613-4602-88e0-9c66b49ae8e5 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:40.966150 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-46de092c-f181-46c1-9386-98d4319275a3 req-a1ffbc7b-6613-4602-88e0-9c66b49ae8e5 service nova] Creating event network-changed:6a04286a-4e1b-4373-82cc-0675f7e93c74 for instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 on hv-cinder-85407 Aug 23 08:34:40.971566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-46de092c-f181-46c1-9386-98d4319275a3 req-a1ffbc7b-6613-4602-88e0-9c66b49ae8e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096514 Aug 23 08:34:40.972153 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 630/1237] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:41.087634 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:41.088767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:41.095523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:41.096767 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:41.097405 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:41.099495 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:41.100147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:41.101820 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:41.318014 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:41.326592 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-702e4bd3-b6c9-4150-9cfc-5fecb3aa551c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1368 microversion: 2.1 time: 0.243379 Aug 23 08:34:41.339594 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 608/1238] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:41 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:42.350697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:42.351551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:42.358227 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:42.358706 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:42.359186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:42.359903 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:42.360364 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:42.360790 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:42.493985 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:42.502058 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-83fadb7f-46ce-4a6c-a30d-0fcc03bc969b tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1368 microversion: 2.1 time: 0.156191 Aug 23 08:34:42.502604 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 631/1239] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:42 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:43.523278 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:43.523943 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:43.531130 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:43.531508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:43.531944 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:43.532645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:43.533100 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:43.533527 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:43.666810 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:43.674631 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-740886b5-cd54-4392-820d-a0409a764cd9 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1368 microversion: 2.1 time: 0.155351 Aug 23 08:34:43.675231 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 609/1240] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:43 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:44.694500 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:44.695184 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:44.701832 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:44.702316 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:44.702753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:44.703475 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:44.703932 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:44.704358 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:44.832593 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:44.840616 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-39520643-5960-4424-ae9e-2825557a7cac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1368 microversion: 2.1 time: 0.149958 Aug 23 08:34:44.841211 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 632/1241] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:44 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:45.861540 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:45.862154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:45.868944 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:45.869590 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:45.870045 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:45.870742 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:45.871228 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:45.871655 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:45.997827 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:46.006099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c42dfb7d-5a93-4969-a87b-2209b087b672 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1368 microversion: 2.1 time: 0.149027 Aug 23 08:34:46.006673 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 610/1242] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:45 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:47.026981 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:47.027722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:47.030166 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:47.034982 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:47.039096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:47.039096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:47.039096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:47.039096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:47.039514 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:47.166915 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-d8e9f017-eb60-4c2a-9ab4-20cf45297462 req-a9337596-aa33-4463-9580-7ed67e9fc70f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d416e99-beb1-43a7-b3a2-8b455c2c8c44", "name": "network-vif-plugged", "status": "completed", "tag": "c8b6cdbf-e105-4f6c-bc6c-f519e171345c"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:47.169926 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:47.173328 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:47.174020 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=10 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:34:47.178342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-140c8272-d1a4-45e5-9ec6-8b25435c9a01 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1368 microversion: 2.1 time: 0.155342 Aug 23 08:34:47.178925 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 633/1243] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:47 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:47.180201 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d8e9f017-eb60-4c2a-9ab4-20cf45297462 req-a9337596-aa33-4463-9580-7ed67e9fc70f service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:47.180693 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d8e9f017-eb60-4c2a-9ab4-20cf45297462 req-a9337596-aa33-4463-9580-7ed67e9fc70f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:47.181125 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-d8e9f017-eb60-4c2a-9ab4-20cf45297462 req-a9337596-aa33-4463-9580-7ed67e9fc70f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:47.192848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-d8e9f017-eb60-4c2a-9ab4-20cf45297462 req-a9337596-aa33-4463-9580-7ed67e9fc70f service nova] Creating event network-vif-plugged:c8b6cdbf-e105-4f6c-bc6c-f519e171345c for instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 on hv-cinder-85407 Aug 23 08:34:47.197819 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-d8e9f017-eb60-4c2a-9ab4-20cf45297462 req-a9337596-aa33-4463-9580-7ed67e9fc70f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034619 Aug 23 08:34:47.198467 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 611/1244] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:34:48.199740 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:48.200351 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:48.207310 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:48.207791 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:48.208225 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:48.208911 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:48.209362 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:48.209782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:48.342822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:48.351066 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-205bc0f5-1bd5-4204-9032-b535a2e39755 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1368 microversion: 2.1 time: 0.155382 Aug 23 08:34:48.351627 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 634/1245] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:48 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:49.372312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:49.373035 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:49.380243 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:49.380727 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:49.381187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:49.381882 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:49.382338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:49.382765 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:49.514050 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:34:49.518328 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-64e36e90-b780-443c-bcff-2c35289cd537 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1558 microversion: 2.1 time: 0.150820 Aug 23 08:34:49.518961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 612/1246] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:34:49 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:34:49.538602 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:34:49.539165 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:34:49.545595 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:49.546732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:49.546732 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:49.547385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:49.547839 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:49.548888 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:49.622995 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-34b77b17-0637-4daf-b41a-e3ca9e59a6ff tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088111 Aug 23 08:34:49.623532 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 635/1247] 10.222.0.58 () {58 vars in 1275 bytes} [Tue Aug 23 08:34:49 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:34:50.586493 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-4c93ed52-b758-4167-b811-f5ce5540509f req-3ec19017-4dc0-4ffc-b8e8-4fb2a2b6f9ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d416e99-beb1-43a7-b3a2-8b455c2c8c44", "tag": "c8b6cdbf-e105-4f6c-bc6c-f519e171345c"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:34:50.596336 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-4c93ed52-b758-4167-b811-f5ce5540509f req-3ec19017-4dc0-4ffc-b8e8-4fb2a2b6f9ab service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:34:50.596824 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-4c93ed52-b758-4167-b811-f5ce5540509f req-3ec19017-4dc0-4ffc-b8e8-4fb2a2b6f9ab service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:34:50.597262 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-4c93ed52-b758-4167-b811-f5ce5540509f req-3ec19017-4dc0-4ffc-b8e8-4fb2a2b6f9ab service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:34:50.608197 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-4c93ed52-b758-4167-b811-f5ce5540509f req-3ec19017-4dc0-4ffc-b8e8-4fb2a2b6f9ab service nova] Creating event network-changed:c8b6cdbf-e105-4f6c-bc6c-f519e171345c for instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 on hv-cinder-85407 Aug 23 08:34:50.613726 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-4c93ed52-b758-4167-b811-f5ce5540509f req-3ec19017-4dc0-4ffc-b8e8-4fb2a2b6f9ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031003 Aug 23 08:34:50.614536 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 613/1248] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:35:24.860772 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:35:24.861310 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Tue Aug 23 08:35:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:36:05.686676 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=11 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:05.687507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:05.691696 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:05.692184 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:05.697929 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:05.703589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:05.703589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:05.703589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:05.703589 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:05.704079 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:05.724197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5c86879b-3d33-4ba9-a0a9-c00d8f6a321d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/ips" status: 200 len: 148 microversion: 2.1 time: 0.039510 Aug 23 08:36:05.724775 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 636/1249] 10.222.0.58 () {58 vars in 1248 bytes} [Tue Aug 23 08:36:05 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:36:08.380310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=13 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:08.381077 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=64 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:08.385743 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8633962-bd9b-4ad2-bf40-58d4165a6056"}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:36:08.388231 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:08.394759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:08.394759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:08.395239 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:08.395934 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:08.396393 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:08.396822 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:09.155275 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1ee51d03-b8ce-40fc-8a61-ffbfc88b4ae1 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "POST /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776748 Aug 23 08:36:09.155829 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 614/1250] 10.222.0.58 () {60 vars in 1323 bytes} [Tue Aug 23 08:36:08 2022] POST /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-volume_attachments => generated 194 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:36:16.771993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:16.772554 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:16.774333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=2 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:16.779918 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:16.780406 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:16.780849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:16.781545 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:16.782003 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:16.782425 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:16.862230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lazy-loading 'services' on Instance uuid 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:36:17.104892 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ce29193b-4048-4e13-9479-07ca0017ccb2 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-volume_attachments/c8633962-bd9b-4ad2-bf40-58d4165a6056" status: 202 len: 0 microversion: 2.1 time: 0.337063 Aug 23 08:36:17.105571 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 637/1251] 10.222.0.58 () {58 vars in 1416 bytes} [Tue Aug 23 08:36:16 2022] DELETE /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-volume_attachments/c8633962-bd9b-4ad2-bf40-58d4165a6056 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:36:17.114432 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:17.116918 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:17.123831 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:17.124321 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:17.124757 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:17.125472 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:17.125970 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:17.126431 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:17.157212 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-85ee2396-08b3-49f2-b086-fa7b5085e0ba tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Aug 23 08:36:17.157796 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 615/1252] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:36:17 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:36:18.171304 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:18.173729 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:18.180592 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:18.181144 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:18.181582 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:18.182284 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:18.182736 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:18.183190 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:18.221438 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-21828a14-92a4-47ff-ba1f-d5f6a8b1cfde tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055448 Aug 23 08:36:18.222065 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 638/1253] 10.222.0.58 () {58 vars in 1302 bytes} [Tue Aug 23 08:36:18 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 08:36:18.283322 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:18.283926 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:18.290399 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:18.290884 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:18.291364 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:18.292731 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:18.293194 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:18.293619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:18.320506 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:36:18.657989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-d6d38ef5-bc02-46d3-91e1-2fcc141e98f7 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 204 len: 0 microversion: 2.1 time: 0.378227 Aug 23 08:36:18.658786 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 616/1254] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:36:18 2022] DELETE /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:36:18.666682 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:18.667327 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:18.673310 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:18.673787 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:18.674221 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:18.674953 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:18.675419 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:18.675845 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:18.804444 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:18.812261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-253466bc-f38f-42b2-9e09-9dba3c1f54b6 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1681 microversion: 2.1 time: 0.149400 Aug 23 08:36:18.812825 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 639/1255] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:18 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:19.834337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:19.835059 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:19.841981 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:19.842460 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:19.842895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:19.843610 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:19.844062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:19.844484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:19.980340 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:19.983254 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-3ec7d01d-1f88-4268-9984-cfc1179226ea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1681 microversion: 2.1 time: 0.153108 Aug 23 08:36:19.983823 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 617/1256] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:19 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:21.004245 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:21.004897 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:21.011230 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:21.011707 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:21.012136 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:21.012841 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:21.013285 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:21.013700 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:21.195782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:21.204222 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b89c4ab4-d312-4698-b0ac-a94c78f6b4db tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1681 microversion: 2.1 time: 0.203821 Aug 23 08:36:21.205035 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 640/1257] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:20 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:21.890439 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-f525e13e-8c03-4133-bee9-167f56403b82 req-c3661912-f792-4d88-a6b2-ba94e3340e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d416e99-beb1-43a7-b3a2-8b455c2c8c44", "name": "network-vif-deleted", "tag": "c8b6cdbf-e105-4f6c-bc6c-f519e171345c"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:36:21.900660 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f525e13e-8c03-4133-bee9-167f56403b82 req-c3661912-f792-4d88-a6b2-ba94e3340e0c service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:21.901221 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f525e13e-8c03-4133-bee9-167f56403b82 req-c3661912-f792-4d88-a6b2-ba94e3340e0c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:21.901742 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-f525e13e-8c03-4133-bee9-167f56403b82 req-c3661912-f792-4d88-a6b2-ba94e3340e0c service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:21.912852 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-f525e13e-8c03-4133-bee9-167f56403b82 req-c3661912-f792-4d88-a6b2-ba94e3340e0c service nova] Creating event network-vif-deleted:c8b6cdbf-e105-4f6c-bc6c-f519e171345c for instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 on hv-cinder-85407 Aug 23 08:36:21.917804 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-f525e13e-8c03-4133-bee9-167f56403b82 req-c3661912-f792-4d88-a6b2-ba94e3340e0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031903 Aug 23 08:36:21.918535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 618/1258] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:36:22.225831 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:22.226455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:22.233268 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:22.233756 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:22.234192 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:22.234987 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:22.235450 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:22.235879 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:22.268844 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:22.269333 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:22.269799 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:22.270256 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lazy-loading 'fault' on Instance uuid 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:36:22.311289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd780debf950447b983dc94edfc681a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1367659f7d6a404393adca1c5d713c99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:22.318754 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9243c549-48c6-4000-9831-95bdd79fddf0 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 200 len: 1332 microversion: 2.1 time: 0.096957 Aug 23 08:36:22.319349 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 641/1259] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:22 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:23.340542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:23.341277 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:23.347937 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:23.348427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:23.348868 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:23.349558 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:23.350016 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:23.350444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:23.364247 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 HTTP/1.1 Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:36:23.365878 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:23.367650 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '5d416e99-beb1-43a7-b3a2-8b455c2c8c44'} Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:23.368683 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:23.370354 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:23.372563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:23.372563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-78e5e583-791a-4cfa-85f5-07b42a1cb02c tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 404 len: 111 microversion: 2.1 time: 0.031025 Aug 23 08:36:23.372563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 619/1260] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:23 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:23.376765 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-33c0243e-a238-4b92-a086-5eb5c5fc1f05 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '.version_select at 0x7fa61a0a5b80>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:23.512045 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-33c0243e-a238-4b92-a086-5eb5c5fc1f05 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046344612" status: 202 len: 0 microversion: 2.1 time: 0.139098 Aug 23 08:36:23.512626 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 642/1261] 10.222.0.58 () {58 vars in 1221 bytes} [Tue Aug 23 08:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1046344612 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:36:25.583710 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:25.584223 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:25.591266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:25.591757 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:25.592201 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:25.592895 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:25.593355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:25.593785 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:25.607180 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 HTTP/1.1 Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:36:25.608705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.610529 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '5d416e99-beb1-43a7-b3a2-8b455c2c8c44'} Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:25.611566 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.613253 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.614903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:25.614903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6814095d-2918-48eb-8eaa-b3837186b42d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 404 len: 111 microversion: 2.1 time: 0.030193 Aug 23 08:36:25.614903 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 620/1262] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:36:25 2022] DELETE /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:25.618931 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:25.619569 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 5d416e99-beb1-43a7-b3a2-8b455c2c8c44] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:25.626522 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:25.627027 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:25.627465 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:25.628163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:25.628623 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:25.629052 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:25.642761 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 HTTP/1.1 Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:36:25.644422 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.646174 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '5d416e99-beb1-43a7-b3a2-8b455c2c8c44'} Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:25.647215 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. Aug 23 08:36:25.648753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:25.650261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance 5d416e99-beb1-43a7-b3a2-8b455c2c8c44 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:25.650261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-6bec3d37-d22a-4ff3-a247-bb8fd4bc948d tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44" status: 404 len: 111 microversion: 2.1 time: 0.031171 Aug 23 08:36:25.650261 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 643/1263] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:25 2022] GET /compute/v2.1/servers/5d416e99-beb1-43a7-b3a2-8b455c2c8c44 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:26.915187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:26.919525 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:26.922062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:26.922545 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:26.923038 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:26.923738 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:26.924200 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:26.924630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:26.938003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e HTTP/1.1 Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:36:26.939608 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.941338 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'a4bdf61b-1981-4500-a2f4-79cd870ade7e'} Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:26.942192 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.948900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.951078 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:26.951078 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-cfb0bbcf-b8ca-4725-9879-8468b19d84ab tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 404 len: 111 microversion: 2.1 time: 0.029714 Aug 23 08:36:26.951078 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 621/1264] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:36:26 2022] DELETE /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:26.951360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:26.951360 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: a4bdf61b-1981-4500-a2f4-79cd870ade7e] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:26.957208 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:26.957691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:26.958127 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:26.958819 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:26.959300 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:26.959756 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:26.973628 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e HTTP/1.1 Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:36:26.976870 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.978535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'a4bdf61b-1981-4500-a2f4-79cd870ade7e'} Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:26.979538 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. Aug 23 08:36:26.981386 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:26.982802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance a4bdf61b-1981-4500-a2f4-79cd870ade7e could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:26.982802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4b80e5ce-1c3c-4c0d-ba4d-5779e0578d25 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e" status: 404 len: 111 microversion: 2.1 time: 0.030967 Aug 23 08:36:26.982802 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 644/1265] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:26 2022] GET /compute/v2.1/servers/a4bdf61b-1981-4500-a2f4-79cd870ade7e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:26.984873 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:26.985357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:26.991255 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:26.991739 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:26.992178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:26.995052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:26.995052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:26.995052 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:27.007522 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf HTTP/1.1 Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:36:27.009062 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.010752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'fb0dc241-0001-4701-8766-de9c809ec2bf'} Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:27.011647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.013454 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.014761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:27.014761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-c3e08c33-87e4-41f9-a694-c13a9aca05ac tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 404 len: 111 microversion: 2.1 time: 0.029474 Aug 23 08:36:27.014761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 622/1266] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:36:26 2022] DELETE /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:27.019501 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:27.020141 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: fb0dc241-0001-4701-8766-de9c809ec2bf] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:27.026037 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:27.026516 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:27.026994 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:27.027731 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:27.028756 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:27.029189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:27.042460 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf HTTP/1.1 Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:36:27.043942 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.045586 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': 'fb0dc241-0001-4701-8766-de9c809ec2bf'} Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:27.046558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. Aug 23 08:36:27.048137 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:27.049533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance fb0dc241-0001-4701-8766-de9c809ec2bf could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:27.049533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-95b1f3b2-a8da-4dc2-baad-d6d8d0984a60 tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf" status: 404 len: 111 microversion: 2.1 time: 0.029681 Aug 23 08:36:27.049533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 645/1267] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:27 2022] GET /compute/v2.1/servers/fb0dc241-0001-4701-8766-de9c809ec2bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:28.321267 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:28.321752 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:28.328857 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:28.329332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:28.329761 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:28.330441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:28.330892 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:28.331335 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:28.345245 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: DELETE /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 HTTP/1.1 Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:36:28.354539 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.356355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '1c16436b-7038-404f-8a3d-e3c9525cbde4'} Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:28.357312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.358848 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.360555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:28.360555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-1a2f9702-a576-4217-8c21-a317f9199aea tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 404 len: 111 microversion: 2.1 time: 0.030780 Aug 23 08:36:28.360555 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 623/1268] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:36:28 2022] DELETE /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:28.361385 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:28.361997 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] [instance: 1c16436b-7038-404f-8a3d-e3c9525cbde4] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:28.368598 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:28.369080 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:28.369521 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:28.370240 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:28.370697 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:28.371163 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:28.384577 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] HTTP exception thrown: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Request method failure captured: Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 HTTP/1.1 Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBI_ODZMFMA4XNW8KQsdPG45hO50mhNm_SNnAi0k5EL-fO9ay_yHJnkj73FusbudRG_jlR4MrD-KaeqvEfekjpLGdwqlIKoOTAauxAVnVATKnMd8Glaes2cqFqNyHafLZ6D5D8sY7R5Q00jfOw7wdJqfCVGrEn_UgOOKOqkSNE5gVOSc Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:36:28.386086 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1367659f7d6a404393adca1c5d713c99", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1367659f7d6a404393adca1c5d713c99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 1367659f7d6a404393adca1c5d713c99 Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1005908839 Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: d780debf950447b983dc94edfc681a68 Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-AttachVolumeNegativeTest-1005908839-project Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.388342 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '1c16436b-7038-404f-8a3d-e3c9525cbde4'} Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:36:28.389449 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. Aug 23 08:36:28.391040 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:36:28.392622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] Returning 404 to user: Instance 1c16436b-7038-404f-8a3d-e3c9525cbde4 could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:36:28.392622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-798aa841-9c55-44b3-95c6-48d954c069dc tempest-AttachVolumeNegativeTest-1005908839 tempest-AttachVolumeNegativeTest-1005908839-project] 10.222.0.58 "GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4" status: 404 len: 111 microversion: 2.1 time: 0.029999 Aug 23 08:36:28.392622 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 646/1269] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:28 2022] GET /compute/v2.1/servers/1c16436b-7038-404f-8a3d-e3c9525cbde4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:36:51.383917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1424092608", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-235537889", "security_groups": [{"name": "tempest-secgroup-smoke-296972092"}], "block_device_mapping_v2": [{"uuid": "b594f156-74a7-466f-a013-9c572577359f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "281f3789-20e8-4d95-9efb-a99bc038266f"}]}} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:36:51.394530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:51.395201 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:51.498236 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.network.neutron [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] validate_networks() for [('281f3789-20e8-4d95-9efb-a99bc038266f', None, None, None, None, None)] {{(pid=121383) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 08:36:51.972165 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Flavor limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 08:36:51.972589 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Image limits 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 08:36:51.973061 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Flavor pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 08:36:51.973467 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Image pref 0:0:0 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 08:36:51.973877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.virt.hardware [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121383) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 08:36:51.983603 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:51.984187 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:51.984694 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:51.985516 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:51.985886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:51.986312 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:52.003563 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Getting quotas for project 7625c9efcc924680a5efef3fd71d0272. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 08:36:52.007647 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.quota [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Getting quotas for user db8b5a8edcc34d32a3e9fad54d33cbbc and project 7625c9efcc924680a5efef3fd71d0272. Resources: {'cores', 'ram', 'instances'} {{(pid=121383) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 08:36:52.066458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Going to run 1 instances... {{(pid=121383) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 08:36:52.068659 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b594f156-74a7-466f-a013-9c572577359f',volume_size=None,volume_type=None)] {{(pid=121383) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 08:36:52.552930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR oslo.messaging._drivers.impl_rabbit [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [57e41883-99e1-48b7-95d3-ce5cba2e31a3] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 08:36:53.559961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [57e41883-99e1-48b7-95d3-ce5cba2e31a3] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 54884. Aug 23 08:36:53.564260 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-88337350-1daf-437f-abfa-39a512e7024e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.184398 Aug 23 08:36:53.564978 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 624/1270] 10.222.0.58 () {60 vars in 1147 bytes} [Tue Aug 23 08:36:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 2186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 08:36:53.576224 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-ff7e4706-795c-4b01-afdb-e2e46037cba2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:53.576924 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-ff7e4706-795c-4b01-afdb-e2e46037cba2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:53.579471 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:53.580128 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:36:53.638849 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-ff7e4706-795c-4b01-afdb-e2e46037cba2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:53.646008 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-ff7e4706-795c-4b01-afdb-e2e46037cba2 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1094 microversion: 2.1 time: 0.073864 Aug 23 08:36:53.646612 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 647/1271] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:53 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:54.667986 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-aa7769ea-c8d8-44c1-92b0-917963d9c261 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:54.669099 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-aa7769ea-c8d8-44c1-92b0-917963d9c261 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:54.722235 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-aa7769ea-c8d8-44c1-92b0-917963d9c261 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:54.729031 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-aa7769ea-c8d8-44c1-92b0-917963d9c261 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1094 microversion: 2.1 time: 0.065456 Aug 23 08:36:54.729607 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 625/1272] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:54 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:55.752829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e8690620-1782-43bb-8b4a-95687ef9ab41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:55.753484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e8690620-1782-43bb-8b4a-95687ef9ab41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:55.813026 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e8690620-1782-43bb-8b4a-95687ef9ab41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:55.820164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e8690620-1782-43bb-8b4a-95687ef9ab41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1094 microversion: 2.1 time: 0.074476 Aug 23 08:36:55.820771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 648/1273] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:55 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:56.842712 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b8c679c7-4e77-43cd-907a-1abbb18b01a0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:56.846141 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b8c679c7-4e77-43cd-907a-1abbb18b01a0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:56.899132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b8c679c7-4e77-43cd-907a-1abbb18b01a0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:56.909620 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b8c679c7-4e77-43cd-907a-1abbb18b01a0 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1094 microversion: 2.1 time: 0.071500 Aug 23 08:36:56.910224 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 626/1274] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:56 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:57.930705 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:57.931348 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:57.938660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:57.939223 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:57.939660 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:57.940361 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:57.940823 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:57.941243 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:58.011597 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:58.019529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-c1ed6cc1-200d-42c0-ac41-d62b349fcbe4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1144 microversion: 2.1 time: 0.092612 Aug 23 08:36:58.020103 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 649/1275] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:57 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:36:59.040697 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:36:59.041304 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:36:59.048642 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:59.049137 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:59.049588 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:59.050292 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:36:59.050780 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:36:59.051226 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:36:59.127132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:36:59.134899 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-81233e5d-a11a-44da-9b53-688ca27cebad tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1192 microversion: 2.1 time: 0.098203 Aug 23 08:36:59.135497 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 627/1276] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:36:59 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:00.155531 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:00.156096 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:00.162583 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:00.163093 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:00.163529 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:00.164233 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:00.164789 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:00.165099 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:00.234128 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:00.241900 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-32a3d1ea-ffc2-42b9-8bbb-a241daefee1b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1210 microversion: 2.1 time: 0.090422 Aug 23 08:37:00.242689 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 650/1277] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:00 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:01.263599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:01.264287 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:01.271304 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:01.271809 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:01.272409 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:01.273189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:01.273874 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:01.274378 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:01.411077 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:01.418917 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-beef5a2e-52b0-4d4d-ade1-96009c6b3202 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1277 microversion: 2.1 time: 0.159716 Aug 23 08:37:01.419520 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 628/1278] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:01 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:01.702714 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-dbf4d3c6-afe3-43ee-bd70-70912ba3cfd1 req-51bc0c53-d7a6-4ba0-8e95-334d2828b3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707b2932-648a-45aa-9fa0-6d2782be5630", "tag": "b197744b-30a3-424c-b053-b163039f1962"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:37:01.713083 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dbf4d3c6-afe3-43ee-bd70-70912ba3cfd1 req-51bc0c53-d7a6-4ba0-8e95-334d2828b3c3 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:01.716843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dbf4d3c6-afe3-43ee-bd70-70912ba3cfd1 req-51bc0c53-d7a6-4ba0-8e95-334d2828b3c3 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:01.716843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-dbf4d3c6-afe3-43ee-bd70-70912ba3cfd1 req-51bc0c53-d7a6-4ba0-8e95-334d2828b3c3 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:01.725189 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-dbf4d3c6-afe3-43ee-bd70-70912ba3cfd1 req-51bc0c53-d7a6-4ba0-8e95-334d2828b3c3 service nova] Creating event network-changed:b197744b-30a3-424c-b053-b163039f1962 for instance 707b2932-648a-45aa-9fa0-6d2782be5630 on hv-cinder-85407 Aug 23 08:37:01.730289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-dbf4d3c6-afe3-43ee-bd70-70912ba3cfd1 req-51bc0c53-d7a6-4ba0-8e95-334d2828b3c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031878 Aug 23 08:37:01.730904 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 651/1279] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 08:37:02.439606 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:02.440223 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:02.442090 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=2 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:37:02.447556 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:02.448051 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:02.451759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:02.451759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:02.451759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:02.451759 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:02.589887 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:02.598270 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-cc61f9de-0491-4620-a8f8-4d7032f82618 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.162618 Aug 23 08:37:02.598851 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 629/1280] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:02 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:03.620683 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:03.621379 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:03.631271 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:03.631766 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:03.632205 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:03.632906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:03.633430 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:03.633795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:03.770164 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:03.778687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-b8e63a6a-bd43-4878-a6b4-5b6e0d0b31bf tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.162243 Aug 23 08:37:03.781671 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 652/1281] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:03 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:04.800331 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:04.800974 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:04.807540 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:04.808033 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:04.808467 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:04.809170 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:04.809629 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:04.810057 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:04.944503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:04.952696 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-164c00a4-d200-4c3d-b80a-c7619c93b6ff tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.156250 Aug 23 08:37:04.953310 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 630/1282] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:04 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:05.974770 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:05.975452 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:05.978148 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell0:SELECT=4 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:37:05.983320 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:05.983860 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:05.984335 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:05.985036 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:05.985494 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:05.985929 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:06.120940 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:06.129703 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-e40e5ab6-79ab-4611-9950-a63ce3747eda tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.158816 Aug 23 08:37:06.130490 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 653/1283] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:05 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:07.149763 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:07.150296 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:07.153102 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell0:SELECT=10 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:37:07.157874 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:07.158355 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:07.158794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:07.159542 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:07.160005 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:07.160427 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:07.292648 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:07.300110 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-39e20a95-532a-4d4d-a03e-184bce944b4e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.154327 Aug 23 08:37:07.300692 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 631/1284] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:07 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:08.321786 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:08.322396 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:08.329843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:08.330375 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:08.330816 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:08.331535 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:08.331989 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:08.332455 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:08.472061 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:08.479929 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-8f079865-fadb-4b7f-b06a-b0ab51ced0da tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.162168 Aug 23 08:37:08.480520 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 654/1285] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:08 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:09.501769 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:09.502318 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:09.509334 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:09.509866 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:09.510314 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:09.511047 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:09.511508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:09.512420 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:09.647541 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:09.655896 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-f706adba-93f8-4c75-bfb9-df6fa631b082 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.158247 Aug 23 08:37:09.656490 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 632/1286] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:09 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:10.068196 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:37:10.068445 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Tue Aug 23 08:37:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:37:10.676608 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:10.677315 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:10.684073 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:10.684558 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:10.684993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:10.685691 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:10.686143 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:10.686566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:10.824864 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:10.832967 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-aeefba2c-b809-4ece-85ec-2bd6ee4385af tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.160298 Aug 23 08:37:10.833566 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 655/1287] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:10 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:11.854503 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:11.855341 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:11.862535 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:11.863147 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:11.863585 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:11.864313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:11.864772 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:11.865232 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:12.002982 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:12.011575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-5a132823-0f91-4cee-8460-a4e67dd6ce76 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.161265 Aug 23 08:37:12.012281 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 633/1288] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:11 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:37:12.677534 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:37:12.678025 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Tue Aug 23 08:37:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:37:13.032213 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:13.032742 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:13.038801 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:13.039321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:13.039789 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:13.040481 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:13.040993 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:13.041450 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:13.180914 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:13.189113 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-5adc6ba1-434c-4fe7-b4f1-875bb136f248 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.161151 Aug 23 08:37:13.189822 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 656/1289] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:13 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:13.948132 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-ba733204-a984-4da9-a426-ac19b81911a6 req-bb538454-3369-41b8-ab84-8e890e259a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707b2932-648a-45aa-9fa0-6d2782be5630", "name": "network-vif-plugged", "status": "completed", "tag": "b197744b-30a3-424c-b053-b163039f1962"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:37:13.958530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ba733204-a984-4da9-a426-ac19b81911a6 req-bb538454-3369-41b8-ab84-8e890e259a51 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:13.959017 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ba733204-a984-4da9-a426-ac19b81911a6 req-bb538454-3369-41b8-ab84-8e890e259a51 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:13.959442 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-ba733204-a984-4da9-a426-ac19b81911a6 req-bb538454-3369-41b8-ab84-8e890e259a51 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:13.970908 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-ba733204-a984-4da9-a426-ac19b81911a6 req-bb538454-3369-41b8-ab84-8e890e259a51 service nova] Creating event network-vif-plugged:b197744b-30a3-424c-b053-b163039f1962 for instance 707b2932-648a-45aa-9fa0-6d2782be5630 on hv-cinder-85407 Aug 23 08:37:13.975933 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-ba733204-a984-4da9-a426-ac19b81911a6 req-bb538454-3369-41b8-ab84-8e890e259a51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031585 Aug 23 08:37:13.976532 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 634/1290] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:37:14.210882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:14.211484 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:14.218509 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:14.219014 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:14.221549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:14.221549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:14.221549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:14.221549 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:14.375652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:14.397059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-42254b7e-1791-4056-b4ee-9fa2b0df3be5 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.177934 Aug 23 08:37:14.397059 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 657/1291] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:14 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 08:37:15.422362 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:15.423120 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:15.429179 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:15.429651 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:15.430079 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:15.430777 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:15.431250 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:15.431677 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:15.569449 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:15.578049 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-9dff5c91-c9fe-412d-8a92-f8767c5ca7d1 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1265 microversion: 2.1 time: 0.161056 Aug 23 08:37:15.578622 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 635/1292] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:15 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:16.599359 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:16.599906 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:16.606711 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:16.607287 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:16.607760 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:16.608548 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:16.608842 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:16.609289 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:16.741407 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:16.749138 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-25ecd624-dbe7-4b3f-8e2c-6754473a2a41 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1451 microversion: 2.1 time: 0.153858 Aug 23 08:37:16.749695 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 658/1293] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:16 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:16.768930 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:37:16.769530 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:37:16.775877 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:16.776356 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:16.776787 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:16.777470 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:16.778412 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:16.778867 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:16.911085 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:37:16.919441 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-bd88b4bc-0bde-4837-9643-b66293ffdc6f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1451 microversion: 2.1 time: 0.154320 Aug 23 08:37:16.920012 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 636/1294] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:37:16 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:37:19.074282 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-33d2f674-5a25-4007-bbf9-5a1783264b28 req-c0f36582-60bc-48a7-8055-97cf6650a42f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707b2932-648a-45aa-9fa0-6d2782be5630", "tag": "b197744b-30a3-424c-b053-b163039f1962"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:37:19.085626 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-33d2f674-5a25-4007-bbf9-5a1783264b28 req-c0f36582-60bc-48a7-8055-97cf6650a42f service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:37:19.090734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-33d2f674-5a25-4007-bbf9-5a1783264b28 req-c0f36582-60bc-48a7-8055-97cf6650a42f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:37:19.090734 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-33d2f674-5a25-4007-bbf9-5a1783264b28 req-c0f36582-60bc-48a7-8055-97cf6650a42f service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:37:19.097526 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-33d2f674-5a25-4007-bbf9-5a1783264b28 req-c0f36582-60bc-48a7-8055-97cf6650a42f service nova] Creating event network-changed:b197744b-30a3-424c-b053-b163039f1962 for instance 707b2932-648a-45aa-9fa0-6d2782be5630 on hv-cinder-85407 Aug 23 08:37:19.102627 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-33d2f674-5a25-4007-bbf9-5a1783264b28 req-c0f36582-60bc-48a7-8055-97cf6650a42f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032515 Aug 23 08:37:19.103256 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 659/1295] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:38:44.870000 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:38:44.870647 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Tue Aug 23 08:38:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:39:22.951534 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:39:22.952464 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG dbcounter [-] [121383] Writing DB stats nova_cell1:SELECT=58 {{(pid=121383) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:39:22.954804 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e7484563-b21b-4096-bdf6-bd2b7e57304b] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 08:39:22.955282 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_api:SELECT=30 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:39:22.956326 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG dbcounter [-] [121382] Writing DB stats nova_cell1:SELECT=58 {{(pid=121382) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 08:39:22.957832 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:22.958332 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:22.975989 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:22.976484 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:22.976923 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:22.977627 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:22.978079 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:22.978498 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:23.009900 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Going to try to terminate instance {{(pid=121383) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:39:23.138515 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [req-77b13a61-ae66-4300-a57f-4fc152f25916 req-a9cca134-7f3a-4291-90f3-920a9743384e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "707b2932-648a-45aa-9fa0-6d2782be5630", "tag": "b197744b-30a3-424c-b053-b163039f1962"}]} {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:39:23.149069 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-77b13a61-ae66-4300-a57f-4fc152f25916 req-a9cca134-7f3a-4291-90f3-920a9743384e service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:23.149551 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-77b13a61-ae66-4300-a57f-4fc152f25916 req-a9cca134-7f3a-4291-90f3-920a9743384e service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:23.149984 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [req-77b13a61-ae66-4300-a57f-4fc152f25916 req-a9cca134-7f3a-4291-90f3-920a9743384e service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:23.162652 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.compute.server_external_events [req-77b13a61-ae66-4300-a57f-4fc152f25916 req-a9cca134-7f3a-4291-90f3-920a9743384e service nova] Creating event network-changed:b197744b-30a3-424c-b053-b163039f1962 for instance 707b2932-648a-45aa-9fa0-6d2782be5630 on hv-cinder-85407 Aug 23 08:39:23.168718 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [req-77b13a61-ae66-4300-a57f-4fc152f25916 req-a9cca134-7f3a-4291-90f3-920a9743384e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216355 Aug 23 08:39:23.169311 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 660/1296] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:39:23.598857 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-eb347393-2f49-4caf-961f-950866c1f962 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "DELETE /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 204 len: 0 microversion: 2.1 time: 0.649848 Aug 23 08:39:23.599396 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 637/1297] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:39:22 2022] DELETE /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:39:23.610384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:23.622969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:23.622969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:23.622969 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:23.623747 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:23.624725 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:23.625299 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:23.627026 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:23.828929 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:39:23.837507 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-9c73b5eb-e03c-4c32-b3f8-9a604df53040 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1575 microversion: 2.1 time: 0.232215 Aug 23 08:39:23.838118 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 661/1298] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:23 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1575 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:39:24.862051 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:24.862933 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:24.870003 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:24.870491 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:24.870966 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:24.871695 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:24.872148 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:24.872570 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:25.067134 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:39:25.075190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-b3564d4d-5fc3-4094-ae08-1b08d6c70cf4 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1575 microversion: 2.1 time: 0.218832 Aug 23 08:39:25.075773 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 638/1299] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:24 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1575 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:39:26.097034 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:26.097782 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:26.107034 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:26.107710 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:26.108216 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:26.108956 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:26.109410 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:26.109875 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:26.116420 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO oslo.messaging._drivers.impl_rabbit [-] [e7484563-b21b-4096-bdf6-bd2b7e57304b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 55410. Aug 23 08:39:26.219703 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:39:26.228204 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-fb41e837-4eac-4170-88a8-6a5a6ab748f3 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1390 microversion: 2.1 time: 0.135564 Aug 23 08:39:26.228978 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 662/1300] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:26 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1390 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:39:26.266298 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-95a81d74-0ede-41ab-9b2c-e67d4397daf6 req-310828c7-cf68-4bd9-95b2-c95d00e320a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "707b2932-648a-45aa-9fa0-6d2782be5630", "name": "network-vif-deleted", "tag": "b197744b-30a3-424c-b053-b163039f1962"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:39:26.276523 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-95a81d74-0ede-41ab-9b2c-e67d4397daf6 req-310828c7-cf68-4bd9-95b2-c95d00e320a7 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:26.277005 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-95a81d74-0ede-41ab-9b2c-e67d4397daf6 req-310828c7-cf68-4bd9-95b2-c95d00e320a7 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:26.277444 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-95a81d74-0ede-41ab-9b2c-e67d4397daf6 req-310828c7-cf68-4bd9-95b2-c95d00e320a7 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:26.288717 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-95a81d74-0ede-41ab-9b2c-e67d4397daf6 req-310828c7-cf68-4bd9-95b2-c95d00e320a7 service nova] Creating event network-vif-deleted:b197744b-30a3-424c-b053-b163039f1962 for instance 707b2932-648a-45aa-9fa0-6d2782be5630 on hv-cinder-85407 Aug 23 08:39:26.293811 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-95a81d74-0ede-41ab-9b2c-e67d4397daf6 req-310828c7-cf68-4bd9-95b2-c95d00e320a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031343 Aug 23 08:39:26.294435 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 639/1301] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:39:27.253882 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:27.254479 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:27.260933 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:27.261413 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:27.261843 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:27.262533 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:27.263060 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:27.263471 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:27.299764 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:27.300321 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:27.300753 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:27.301195 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.objects.instance [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lazy-loading 'fault' on Instance uuid 707b2932-648a-45aa-9fa0-6d2782be5630 {{(pid=121382) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 08:39:27.343960 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:39:27.356500 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-821e1f27-e45c-4062-a1d8-7ef7f6bda209 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 200 len: 1230 microversion: 2.1 time: 0.106488 Aug 23 08:39:27.357095 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 663/1302] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:27 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:39:28.379458 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:28.380157 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 707b2932-648a-45aa-9fa0-6d2782be5630] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:28.386971 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:28.387478 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:28.387922 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:28.388706 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:28.389209 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:28.389643 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:28.404237 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] HTTP exception thrown: Instance 707b2932-648a-45aa-9fa0-6d2782be5630 could not be found. Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Request method failure captured: Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 HTTP/1.1 Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBJA2aBCV24D-60XlCBmt6dy-jN1n2f6Yutnw6xvXJyWaDYmRCt1Elv4BKIU1Dx_yAD73iLrCw0wcpFFaw4K1ZMvsb6FJlf15icNDW39I0-QKhRK7AvZQ8hlnmrZNhBRYCTZOyQeGIr6tCrN75Pields5CocUB9yEcJDr9xdLP9IBfw4 Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:39:28.405931 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7625c9efcc924680a5efef3fd71d0272", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: db8b5a8edcc34d32a3e9fad54d33cbbc Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 707b2932-648a-45aa-9fa0-6d2782be5630 could not be found. Aug 23 08:39:28.407619 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '707b2932-648a-45aa-9fa0-6d2782be5630'} Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 707b2932-648a-45aa-9fa0-6d2782be5630 could not be found. Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:39:28.408599 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 707b2932-648a-45aa-9fa0-6d2782be5630 could not be found. Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 707b2932-648a-45aa-9fa0-6d2782be5630 could not be found. Aug 23 08:39:28.410552 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:28.412357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Returning 404 to user: Instance 707b2932-648a-45aa-9fa0-6d2782be5630 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:39:28.412357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-7078a90a-5c6d-47ba-a024-f43dfe5de114 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630" status: 404 len: 111 microversion: 2.1 time: 0.033318 Aug 23 08:39:28.412357 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 640/1303] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:28 2022] GET /compute/v2.1/servers/707b2932-648a-45aa-9fa0-6d2782be5630 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:39:32.162090 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:32.162858 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:32.165064 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-0902ffa4-8b8c-4485-9203-f0c067675e8d req-c193c5fb-8aa0-49bd-83e7-58e71a147520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5e6929-98d3-43e1-b7b4-092cb6f3c568", "tag": "6a04286a-4e1b-4373-82cc-0675f7e93c74"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:39:32.169244 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:32.169722 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:32.170559 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:32.171356 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:32.172010 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:32.172633 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:32.175794 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0902ffa4-8b8c-4485-9203-f0c067675e8d req-c193c5fb-8aa0-49bd-83e7-58e71a147520 service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:32.176281 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0902ffa4-8b8c-4485-9203-f0c067675e8d req-c193c5fb-8aa0-49bd-83e7-58e71a147520 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:32.176716 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-0902ffa4-8b8c-4485-9203-f0c067675e8d req-c193c5fb-8aa0-49bd-83e7-58e71a147520 service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:32.188718 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-0902ffa4-8b8c-4485-9203-f0c067675e8d req-c193c5fb-8aa0-49bd-83e7-58e71a147520 service nova] Creating event network-changed:6a04286a-4e1b-4373-82cc-0675f7e93c74 for instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 on hv-cinder-85407 Aug 23 08:39:32.194888 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-0902ffa4-8b8c-4485-9203-f0c067675e8d req-c193c5fb-8aa0-49bd-83e7-58e71a147520 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033462 Aug 23 08:39:32.195905 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 641/1304] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:39:32.200100 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Going to try to terminate instance {{(pid=121382) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 08:39:32.610630 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-86dab244-008e-4e6c-b91f-4ce7846d357b tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 204 len: 0 microversion: 2.1 time: 0.452736 Aug 23 08:39:32.611650 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 664/1305] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:39:32 2022] DELETE /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 08:39:32.621020 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:32.623940 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:32.628952 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:32.629531 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:32.630195 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:32.630821 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:32.631379 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:32.632143 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:32.773991 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.policy [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121383) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:39:32.783469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-6ba8c298-6c84-456b-940d-41c11bc7195d tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1576 microversion: 2.1 time: 0.166064 Aug 23 08:39:32.783469 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 642/1306] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:32 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:39:33.806483 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:33.807199 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:33.813884 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:33.814384 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:33.814971 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:33.816297 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:33.816767 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:33.817169 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:34.023442 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:39:34.031367 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-4dc0f37b-647e-4659-a196-b6c726bfb66e tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1457 microversion: 2.1 time: 0.229569 Aug 23 08:39:34.031934 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 665/1307] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:33 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1457 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:39:34.494768 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [req-42b2a425-2398-4fca-8152-aa66dc2b0777 req-8da9a5c9-2a7d-4a92-b847-b20831b9745e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5e6929-98d3-43e1-b7b4-092cb6f3c568", "name": "network-vif-deleted", "tag": "6a04286a-4e1b-4373-82cc-0675f7e93c74"}]} {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 08:39:34.504575 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-42b2a425-2398-4fca-8152-aa66dc2b0777 req-8da9a5c9-2a7d-4a92-b847-b20831b9745e service nova] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:34.505054 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-42b2a425-2398-4fca-8152-aa66dc2b0777 req-8da9a5c9-2a7d-4a92-b847-b20831b9745e service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:34.505485 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [req-42b2a425-2398-4fca-8152-aa66dc2b0777 req-8da9a5c9-2a7d-4a92-b847-b20831b9745e service nova] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:34.517872 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.compute.server_external_events [req-42b2a425-2398-4fca-8152-aa66dc2b0777 req-8da9a5c9-2a7d-4a92-b847-b20831b9745e service nova] Creating event network-vif-deleted:6a04286a-4e1b-4373-82cc-0675f7e93c74 for instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 on hv-cinder-85407 Aug 23 08:39:34.523178 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [req-42b2a425-2398-4fca-8152-aa66dc2b0777 req-8da9a5c9-2a7d-4a92-b847-b20831b9745e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032467 Aug 23 08:39:34.523787 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 643/1308] 10.222.0.58 () {64 vars in 1317 bytes} [Tue Aug 23 08:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 08:39:35.052467 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:35.053032 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:35.059813 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:35.060309 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:35.060749 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:35.061454 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:35.061994 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:35.062459 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:35.127116 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.policy [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db8b5a8edcc34d32a3e9fad54d33cbbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7625c9efcc924680a5efef3fd71d0272', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121382) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 08:39:35.135771 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-3f9534b8-1e88-4ae3-abfd-6a1dd9cf69b6 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 200 len: 1225 microversion: 2.1 time: 0.087290 Aug 23 08:39:35.136365 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 666/1309] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:35 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 08:39:36.160337 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:36.161240 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: ff5e6929-98d3-43e1-b7b4-092cb6f3c568] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:36.167791 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:36.168322 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:36.168814 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:36.169645 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:36.170142 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:36.170747 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:36.184961 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] HTTP exception thrown: Instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 could not be found. Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Request method failure captured: Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 HTTP/1.1 Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBJA2aBCV24D-60XlCBmt6dy-jN1n2f6Yutnw6xvXJyWaDYmRCt1Elv4BKIU1Dx_yAD73iLrCw0wcpFFaw4K1ZMvsb6FJlf15icNDW39I0-QKhRK7AvZQ8hlnmrZNhBRYCTZOyQeGIr6tCrN75Pields5CocUB9yEcJDr9xdLP9IBfw4 Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:39:36.186623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7625c9efcc924680a5efef3fd71d0272", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: db8b5a8edcc34d32a3e9fad54d33cbbc Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 could not be found. Aug 23 08:39:36.188264 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': 'ff5e6929-98d3-43e1-b7b4-092cb6f3c568'} Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 could not be found. Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:39:36.189154 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 could not be found. Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 could not be found. Aug 23 08:39:36.191206 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.193508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Returning 404 to user: Instance ff5e6929-98d3-43e1-b7b4-092cb6f3c568 could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:39:36.193508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-66b5eb7b-b657-4748-846d-8cff12a0e68f tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568" status: 404 len: 111 microversion: 2.1 time: 0.033560 Aug 23 08:39:36.193508 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 644/1310] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:36 2022] GET /compute/v2.1/servers/ff5e6929-98d3-43e1-b7b4-092cb6f3c568 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:39:36.727197 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:36.727765 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.compute.api [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121382) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:36.733755 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:36.734247 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:36.734687 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:36.735416 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:36.735871 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:36.736302 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG oslo_concurrency.lockutils [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121382) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:36.750634 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.wsgi [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] HTTP exception thrown: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Request method failure captured: Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: request: DELETE /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f HTTP/1.1 Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept: application/json Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Accept-Encoding: identity Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Connection: close Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Length: 0 Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Content-Type: application/json Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Host: 10.222.0.58 Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Openstack-System-Scope: None Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: User-Agent: python-urllib3/1.26.11 Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Auth-Token: gAAAAABjBJA2aBCV24D-60XlCBmt6dy-jN1n2f6Yutnw6xvXJyWaDYmRCt1Elv4BKIU1Dx_yAD73iLrCw0wcpFFaw4K1ZMvsb6FJlf15icNDW39I0-QKhRK7AvZQ8hlnmrZNhBRYCTZOyQeGIr6tCrN75Pields5CocUB9yEcJDr9xdLP9IBfw4 Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Id: None Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Domain-Name: None Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Identity-Status: Confirmed Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Is-Admin-Project: True Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Id: default Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Domain-Name: Default Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Project-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Role: reader,member Aug 23 08:39:36.752357 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Roles: reader,member Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7625c9efcc924680a5efef3fd71d0272", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-Tenant-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Id: default Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Domain-Name: Default Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Id: db8b5a8edcc34d32a3e9fad54d33cbbc Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: X-User-Name: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: method: > Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: exception: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.754226 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: action_args: {'id': '8cca62a1-fe32-41f1-90cd-a8d61e008f7f'} Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:39:36.755262 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.756991 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.758829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Returning 404 to user: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. {{(pid=121382) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:39:36.758829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-cd02efe2-a628-4220-840f-d1480111d0fa tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 404 len: 111 microversion: 2.1 time: 0.031074 Aug 23 08:39:36.758829 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 667/1311] 10.222.0.58 () {58 vars in 1239 bytes} [Tue Aug 23 08:39:36 2022] DELETE /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:39:36.762839 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '>' {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:36.763795 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.compute.api [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] [instance: 8cca62a1-fe32-41f1-90cd-a8d61e008f7f] Fetching instance by UUID {{(pid=121383) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 08:39:36.769699 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:36.770190 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:36.770630 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:36.771361 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Acquiring lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 08:39:36.771819 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 08:39:36.772266 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG oslo_concurrency.lockutils [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Lock "cfa477d1-7cac-413e-8fa7-186dfaa13509" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121383) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 08:39:36.789812 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.wsgi [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] HTTP exception thrown: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Request method failure captured: Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: request: GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f HTTP/1.1 Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept: application/json Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Accept-Encoding: identity Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Connection: close Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Length: 0 Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Content-Type: application/json Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Host: 10.222.0.58 Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Openstack-System-Scope: None Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: User-Agent: python-urllib3/1.26.11 Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Auth-Token: gAAAAABjBJA2aBCV24D-60XlCBmt6dy-jN1n2f6Yutnw6xvXJyWaDYmRCt1Elv4BKIU1Dx_yAD73iLrCw0wcpFFaw4K1ZMvsb6FJlf15icNDW39I0-QKhRK7AvZQ8hlnmrZNhBRYCTZOyQeGIr6tCrN75Pields5CocUB9yEcJDr9xdLP9IBfw4 Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Id: None Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Domain-Name: None Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Identity-Status: Confirmed Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Is-Admin-Project: True Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Id: default Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Domain-Name: Default Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Project-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Role: reader,member Aug 23 08:39:36.791372 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Roles: reader,member Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7625c9efcc924680a5efef3fd71d0272", "adminURL": "http://10.222.0.58:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7625c9efcc924680a5efef3fd71d0272"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}] Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Id: 7625c9efcc924680a5efef3fd71d0272 Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-Tenant-Name: tempest-TestVolumeBootPattern-1811970144 Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Id: default Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Domain-Name: Default Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Id: db8b5a8edcc34d32a3e9fad54d33cbbc Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: X-User-Name: tempest-TestVolumeBootPattern-1811970144-project Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: method: > Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: exception: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.793189 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: action_args: {'id': '8cca62a1-fe32-41f1-90cd-a8d61e008f7f'} Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: {{(pid=121383) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 08:39:36.794313 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. Aug 23 08:39:36.795904 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: ERROR nova.api.openstack.wsgi Aug 23 08:39:36.797533 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: DEBUG nova.api.openstack.wsgi [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Returning 404 to user: Instance 8cca62a1-fe32-41f1-90cd-a8d61e008f7f could not be found. {{(pid=121383) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 08:39:36.797533 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO nova.api.openstack.requestlog [None req-a6fed1b8-277b-4586-8044-b43d7c6b6214 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f" status: 404 len: 111 microversion: 2.1 time: 0.033959 Aug 23 08:39:36.797533 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: [pid: 121383|app: 0|req: 645/1312] 10.222.0.58 () {58 vars in 1236 bytes} [Tue Aug 23 08:39:36 2022] GET /compute/v2.1/servers/8cca62a1-fe32-41f1-90cd-a8d61e008f7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 08:39:38.388078 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: DEBUG nova.api.openstack.wsgi [None req-849fb3fc-b070-466a-958d-d074e6f31619 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] Calling method '.version_select at 0x7fa61a1831f0>' {{(pid=121382) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 08:39:38.464005 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO nova.api.openstack.requestlog [None req-849fb3fc-b070-466a-958d-d074e6f31619 tempest-TestVolumeBootPattern-1811970144 tempest-TestVolumeBootPattern-1811970144-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-235537889" status: 202 len: 0 microversion: 2.1 time: 0.079718 Aug 23 08:39:38.464693 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: [pid: 121382|app: 0|req: 668/1313] 10.222.0.58 () {58 vars in 1260 bytes} [Tue Aug 23 08:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-235537889 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 08:40:30.076886 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:40:30.077483 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Tue Aug 23 08:40:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:40:32.686584 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:40:32.687220 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Tue Aug 23 08:40:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:42:04.880051 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:42:04.880745 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Tue Aug 23 08:42:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:42:08.787623 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:42:08.788108 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Tue Aug 23 08:42:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:42:25.632705 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:42:25.633366 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Tue Aug 23 08:42:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:43:50.085246 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:43:50.085945 dv-cinder-854070-4-iscsi devstack@n-api.service[121383]: Tue Aug 23 08:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 08:43:52.695186 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 08:43:52.695795 dv-cinder-854070-4-iscsi devstack@n-api.service[121382]: Tue Aug 23 08:43:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!